[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:05 dist-test-slave-266d krb5kdc[17153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:05 dist-test-slave-266d krb5kdc[17153](info): set up 2 sockets
Aug 09 18:56:05 dist-test-slave-266d krb5kdc[17153](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 18:56:07.207607 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.388s user 0.001s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:07 dist-test-slave-266d krb5kdc[17153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:07.375264 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:43443
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:43443
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:07.798491 17177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:07.798954 17177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:07.799192 17177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:07.808826 17177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:07.809000 17177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:07.809123 17177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:07.809209 17177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:07.809314 17177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:07.822758 17177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:43443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:43443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:07.824847 17177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:07.826822 17177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:07.850236 17188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:07.850495 17186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:07.851326 17183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:07.852908 17177 server_base.cc:1034] running on GCE node
I20260809 18:56:07.854204 17177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:07.856805 17177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:07.858094 17177 hybrid_clock.cc:648] HybridClock initialized: now 1786301767857933 us; error 116 us; skew 500 ppm
I20260809 18:56:07.858712 17177 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:07 dist-test-slave-266d krb5kdc[17153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301767, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:07.863471 17177 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:07.866539 17177 webserver.cc:460] Webserver started at http://127.16.188.254:44023/ using document root <none> and password file <none>
I20260809 18:56:07.867851 17177 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:07.868062 17177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:07.868533 17177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:07.873597 17177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "3d0335e7dcce400098376bc0491c3532"
format_stamp: "Formatted at 2026-08-09 18:56:07 on dist-test-slave-266d"
server_key: "a95ed15a9b4eea19bbacf417e65755e8"
server_key_iv: "623cf542ba237c586d0510e306dba316"
server_key_version: "encryptionkey@0"
I20260809 18:56:07.874538 17177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "3d0335e7dcce400098376bc0491c3532"
format_stamp: "Formatted at 2026-08-09 18:56:07 on dist-test-slave-266d"
server_key: "a95ed15a9b4eea19bbacf417e65755e8"
server_key_iv: "623cf542ba237c586d0510e306dba316"
server_key_version: "encryptionkey@0"
I20260809 18:56:07.883663 17177 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.002s
I20260809 18:56:07.890225 17204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:07.892253 17177 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260809 18:56:07.892554 17177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "3d0335e7dcce400098376bc0491c3532"
format_stamp: "Formatted at 2026-08-09 18:56:07 on dist-test-slave-266d"
server_key: "a95ed15a9b4eea19bbacf417e65755e8"
server_key_iv: "623cf542ba237c586d0510e306dba316"
server_key_version: "encryptionkey@0"
I20260809 18:56:07.892800 17177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:07.908735 17177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:07.914987 17177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:07.915460 17177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:07.949689 17177 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:43443
I20260809 18:56:07.949771 17279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:43443 every 8 connection(s)
I20260809 18:56:07.952042 17177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:07.958941 17280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:07.962718 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17177
I20260809 18:56:07.963069 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:07.965248 17139 external_mini_cluster.cc:1428] Setting key 8374fb70b164c0339186de3dcc7d7fc2
I20260809 18:56:07.974877 17280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532: Bootstrap starting.
I20260809 18:56:07.980019 17280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:07.981734 17280 log.cc:824] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:07.986742 17280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532: No bootstrap required, opened a new log
Aug 09 18:56:07 dist-test-slave-266d krb5kdc[17153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:08.000010 17280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0335e7dcce400098376bc0491c3532" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43443 } }
I20260809 18:56:08.000488 17280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:08.000658 17280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d0335e7dcce400098376bc0491c3532, State: Initialized, Role: FOLLOWER
I20260809 18:56:08.001961 17280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0335e7dcce400098376bc0491c3532" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43443 } }
I20260809 18:56:08.002491 17280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:08.002902 17280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:08.003154 17280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:08.006803 17280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0335e7dcce400098376bc0491c3532" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43443 } }
I20260809 18:56:08.007937 17280 leader_election.cc:302] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d0335e7dcce400098376bc0491c3532; no voters:
I20260809 18:56:08.008876 17280 leader_election.cc:288] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:08.009179 17285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:08.011369 17285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [term 1 LEADER]: Becoming Leader. State: Replica: 3d0335e7dcce400098376bc0491c3532, State: Running, Role: LEADER
I20260809 18:56:08.012328 17285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0335e7dcce400098376bc0491c3532" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43443 } }
I20260809 18:56:08.013029 17280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:08.015640 17282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:07.971078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56672 (local address 127.16.188.254:43443)
0809 18:56:07.972225 (+ 1147us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:07.972242 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:07.973389 (+ 1147us) server_negotiation.cc:407] Connection header received
0809 18:56:07.982929 (+ 9540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:07.982956 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:07.983645 (+ 689us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:07.984152 (+ 507us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:07.987741 (+ 3589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:07.990352 (+ 2611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:07.992493 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:07.993864 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:07.994098 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:08.001457 (+ 7359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:08.001529 (+ 72us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:08.001579 (+ 50us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:08.001670 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:08.006375 (+ 4705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:08.007347 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:08.007354 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:08.007360 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:08.007672 (+ 312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:08.008168 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:08.008173 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:08.008176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:08.009123 (+ 947us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:08.009640 (+ 517us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:08.012514 (+ 2874us) server_negotiation.cc:299] Negotiation successful
0809 18:56:08.012998 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":395,"threads_started":1}
I20260809 18:56:08.020983 17288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d0335e7dcce400098376bc0491c3532. Latest consensus state: current_term: 1 leader_uuid: "3d0335e7dcce400098376bc0491c3532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0335e7dcce400098376bc0491c3532" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43443 } } }
I20260809 18:56:08.019573 17286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d0335e7dcce400098376bc0491c3532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0335e7dcce400098376bc0491c3532" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43443 } } }
I20260809 18:56:08.023241 17288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:08.023262 17286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:08.027594 17296 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:08.040009 17296 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:08.058239 17296 catalog_manager.cc:1347] Generated new cluster ID: 7f88961b2b344056afd95279670abe45
I20260809 18:56:08.058382 17296 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:08.069259 17296 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:08.070976 17296 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:08.083492 17296 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d0335e7dcce400098376bc0491c3532: Generated new TSK 0
I20260809 18:56:08.084460 17296 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:08.152042 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43443
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:08.609534 17318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:08.609930 17318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:08.610080 17318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:08.619014 17318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:08.619148 17318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:08.619338 17318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:08.629704 17318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43443
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:08.630908 17318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:08.632185 17318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:08.644915 17327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:08.644882 17330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:08.644950 17328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:08.645959 17318 server_base.cc:1034] running on GCE node
I20260809 18:56:08.646592 17318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:08.647514 17318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:08.648729 17318 hybrid_clock.cc:648] HybridClock initialized: now 1786301768648672 us; error 42 us; skew 500 ppm
I20260809 18:56:08.649039 17318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:08 dist-test-slave-266d krb5kdc[17153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301768, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:08.652243 17318 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:08.653692 17318 webserver.cc:460] Webserver started at http://127.16.188.193:40967/ using document root <none> and password file <none>
I20260809 18:56:08.654337 17318 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:08.654448 17318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:08.654768 17318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:08.658066 17318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "27a44f8c79b04fe697bd133c0fd5bbcd"
format_stamp: "Formatted at 2026-08-09 18:56:08 on dist-test-slave-266d"
server_key: "bcea9a81a3e2017621a055f71aa867d8"
server_key_iv: "5ccfab555b239feadf27a1dfbb7bfe90"
server_key_version: "encryptionkey@0"
I20260809 18:56:08.658826 17318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "27a44f8c79b04fe697bd133c0fd5bbcd"
format_stamp: "Formatted at 2026-08-09 18:56:08 on dist-test-slave-266d"
server_key: "bcea9a81a3e2017621a055f71aa867d8"
server_key_iv: "5ccfab555b239feadf27a1dfbb7bfe90"
server_key_version: "encryptionkey@0"
I20260809 18:56:08.664225 17318 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 18:56:08.667469 17341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:08.668684 17318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:08.668821 17318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "27a44f8c79b04fe697bd133c0fd5bbcd"
format_stamp: "Formatted at 2026-08-09 18:56:08 on dist-test-slave-266d"
server_key: "bcea9a81a3e2017621a055f71aa867d8"
server_key_iv: "5ccfab555b239feadf27a1dfbb7bfe90"
server_key_version: "encryptionkey@0"
I20260809 18:56:08.668973 17318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:08.697181 17318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:08.701057 17318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:08.701319 17318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:08.702250 17318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:08.704015 17318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:08.704098 17318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:08.704277 17318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:08.704346 17318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:08.749414 17318 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:36887
I20260809 18:56:08.749506 17504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:36887 every 8 connection(s)
I20260809 18:56:08.751122 17318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:08.752843 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17318
I20260809 18:56:08.753300 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:08.754132 17139 external_mini_cluster.cc:1428] Setting key 96c0b0ab89c82b5c0b8a7fdd30824df2
Aug 09 18:56:08 dist-test-slave-266d krb5kdc[17153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301768, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
I20260809 18:56:08.775470 17509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:08.755130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:54763 (local address 127.16.188.254:43443)
0809 18:56:08.755817 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:08.755822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:08.757774 (+ 1952us) server_negotiation.cc:407] Connection header received
0809 18:56:08.759628 (+ 1854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:08.759634 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:08.759713 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:08.759824 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:08.761227 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:08.762429 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:08.764621 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:08.765416 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:08.765542 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:08.769226 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:08.769235 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:08.769240 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:08.769283 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:08.772577 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:08.773395 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:08.773401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:08.773404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:08.773552 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:08.773939 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:08.773943 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:08.773947 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:08.774323 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:08.774442 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:08.775018 (+ 576us) server_negotiation.cc:299] Negotiation successful
0809 18:56:08.775204 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":393,"threads_started":1}
I20260809 18:56:08.776626 17510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:08.756018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43443 (local address 127.16.188.193:54763)
0809 18:56:08.757597 (+ 1579us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:08.757655 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:08.759366 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:08.759995 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:08.760003 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:08.760480 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:08.761022 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:08.761038 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:08.762577 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:08.762582 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:08.764457 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:08.764471 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:08.765629 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:08.765634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:08.765851 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:08.766545 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:08.766574 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:08.768927 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:08.772738 (+ 3811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:08.772746 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:08.772760 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:08.773281 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:08.773651 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:08.773654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:08.773657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:08.773833 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:08.774442 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:08.774447 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:08.774728 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 18:56:08.774933 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 18:56:08.775341 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1239,"thread_start_us":886,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
I20260809 18:56:08.778234 17505 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43443
I20260809 18:56:08.778648 17505 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:08.779490 17505 heartbeater.cc:511] Master 127.16.188.254:43443 requested a full tablet report, sending...
I20260809 18:56:08.783610 17230 ts_manager.cc:194] Registered new tserver with Master: 27a44f8c79b04fe697bd133c0fd5bbcd (127.16.188.193:36887)
I20260809 18:56:08.785722 17230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:54763
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:08.799903 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43443
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:09.220238 17515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:09.220551 17515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:09.220721 17515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:09.228179 17515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:09.228318 17515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:09.228487 17515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:09.238690 17515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43443
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:09.240005 17515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:09.241483 17515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:09.255007 17522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:09.255010 17525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:09.254946 17527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:09.256387 17515 server_base.cc:1034] running on GCE node
I20260809 18:56:09.256968 17515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:09.257858 17515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:09.259058 17515 hybrid_clock.cc:648] HybridClock initialized: now 1786301769259013 us; error 34 us; skew 500 ppm
I20260809 18:56:09.259351 17515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:09 dist-test-slave-266d krb5kdc[17153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301769, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:09.262365 17515 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:09.263679 17515 webserver.cc:460] Webserver started at http://127.16.188.194:42927/ using document root <none> and password file <none>
I20260809 18:56:09.264333 17515 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:09.264446 17515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:09.264731 17515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:09.267567 17515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "edf8fa2ba03f4dcaad902009b4e6e7d7"
format_stamp: "Formatted at 2026-08-09 18:56:09 on dist-test-slave-266d"
server_key: "7c1b4fd96095b12d863e0bde4d95d2b2"
server_key_iv: "5d204d7b21d4533dc503668bd6630269"
server_key_version: "encryptionkey@0"
I20260809 18:56:09.268342 17515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "edf8fa2ba03f4dcaad902009b4e6e7d7"
format_stamp: "Formatted at 2026-08-09 18:56:09 on dist-test-slave-266d"
server_key: "7c1b4fd96095b12d863e0bde4d95d2b2"
server_key_iv: "5d204d7b21d4533dc503668bd6630269"
server_key_version: "encryptionkey@0"
I20260809 18:56:09.273393 17515 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 18:56:09.276624 17538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:09.277938 17515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:09.278095 17515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "edf8fa2ba03f4dcaad902009b4e6e7d7"
format_stamp: "Formatted at 2026-08-09 18:56:09 on dist-test-slave-266d"
server_key: "7c1b4fd96095b12d863e0bde4d95d2b2"
server_key_iv: "5d204d7b21d4533dc503668bd6630269"
server_key_version: "encryptionkey@0"
I20260809 18:56:09.278270 17515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:09.288650 17515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:09.292153 17515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:09.292395 17515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:09.293468 17515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:09.294729 17515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:09.294802 17515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:09.294896 17515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:09.294945 17515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:09.333961 17515 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:38977
I20260809 18:56:09.334101 17711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:38977 every 8 connection(s)
I20260809 18:56:09.335457 17515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:09.344870 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17515
I20260809 18:56:09.345206 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:09.345991 17139 external_mini_cluster.cc:1428] Setting key 563165f34abf9b07ac1421f467bff898
Aug 09 18:56:09 dist-test-slave-266d krb5kdc[17153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301769, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:09.365165 17714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:09.338921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:42499 (local address 127.16.188.254:43443)
0809 18:56:09.339637 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:09.339642 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:09.340941 (+ 1299us) server_negotiation.cc:407] Connection header received
0809 18:56:09.343694 (+ 2753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:09.343701 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:09.343787 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:09.343896 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:09.346548 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:09.347682 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:09.350440 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:09.351169 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:09.351274 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:09.356809 (+ 5535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:09.356817 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:09.356821 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:09.356862 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:09.361357 (+ 4495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:09.362234 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:09.362240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:09.362244 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:09.362495 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:09.363004 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:09.363009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:09.363011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:09.363460 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:09.363620 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:09.364510 (+ 890us) server_negotiation.cc:299] Negotiation successful
0809 18:56:09.364732 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":490,"threads_started":1}
I20260809 18:56:09.366806 17715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:09.339502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43443 (local address 127.16.188.194:42499)
0809 18:56:09.340771 (+ 1269us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:09.340823 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:09.343411 (+ 2588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:09.344182 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:09.344191 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:09.345220 (+ 1029us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:09.346344 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:09.346373 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:09.347881 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:09.347887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:09.350268 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:09.350286 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:09.351452 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:09.351460 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:09.351864 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:09.352794 (+ 930us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:09.352822 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:09.356381 (+ 3559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:09.361502 (+ 5121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:09.361510 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:09.361525 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:09.362060 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:09.362596 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:09.362599 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:09.362601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:09.362872 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:09.363653 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:09.363660 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:09.364079 (+ 419us) client_negotiation.cc:769] Sending connection context
0809 18:56:09.364421 (+ 342us) client_negotiation.cc:240] Negotiation successful
0809 18:56:09.365049 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":999,"thread_start_us":636,"threads_started":1}
I20260809 18:56:09.368530 17712 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43443
I20260809 18:56:09.368980 17712 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
I20260809 18:56:09.370117 17712 heartbeater.cc:511] Master 127.16.188.254:43443 requested a full tablet report, sending...
I20260809 18:56:09.371759 17230 ts_manager.cc:194] Registered new tserver with Master: edf8fa2ba03f4dcaad902009b4e6e7d7 (127.16.188.194:38977)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
I20260809 18:56:09.372885 17230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:42499
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:56:09.394297 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43443
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:56:09.788939 17505 heartbeater.cc:503] Master 127.16.188.254:43443 was elected leader, sending a full tablet report...
W20260809 18:56:09.823192 17718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:09.823552 17718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:09.823771 17718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:09.833881 17718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:09.834054 17718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:09.834324 17718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:09.849376 17718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43443
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:09.850940 17718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:09.852458 17718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:09.866938 17725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:09.866971 17726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:09.866849 17728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:09.868192 17718 server_base.cc:1034] running on GCE node
I20260809 18:56:09.868757 17718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:09.869719 17718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:09.870925 17718 hybrid_clock.cc:648] HybridClock initialized: now 1786301769870862 us; error 52 us; skew 500 ppm
I20260809 18:56:09.871240 17718 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:09 dist-test-slave-266d krb5kdc[17153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301769, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:09.874614 17718 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:09.876058 17718 webserver.cc:460] Webserver started at http://127.16.188.195:41017/ using document root <none> and password file <none>
I20260809 18:56:09.876689 17718 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:09.876807 17718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:09.877118 17718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:09.879881 17718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "2a90678bb53e4bb8891104c90fecdc21"
format_stamp: "Formatted at 2026-08-09 18:56:09 on dist-test-slave-266d"
server_key: "e613b9745460812ac6c22e7a4e50db69"
server_key_iv: "271b647a061b620c2ec1043d8acc0f32"
server_key_version: "encryptionkey@0"
I20260809 18:56:09.880578 17718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "2a90678bb53e4bb8891104c90fecdc21"
format_stamp: "Formatted at 2026-08-09 18:56:09 on dist-test-slave-266d"
server_key: "e613b9745460812ac6c22e7a4e50db69"
server_key_iv: "271b647a061b620c2ec1043d8acc0f32"
server_key_version: "encryptionkey@0"
I20260809 18:56:09.885581 17718 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 18:56:09.888779 17741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:09.890025 17718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:09.890178 17718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "2a90678bb53e4bb8891104c90fecdc21"
format_stamp: "Formatted at 2026-08-09 18:56:09 on dist-test-slave-266d"
server_key: "e613b9745460812ac6c22e7a4e50db69"
server_key_iv: "271b647a061b620c2ec1043d8acc0f32"
server_key_version: "encryptionkey@0"
I20260809 18:56:09.890352 17718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:09.916429 17718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:09.920104 17718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:09.920356 17718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:09.921239 17718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:09.922467 17718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:09.922546 17718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:09.922659 17718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:09.922711 17718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:09.955344 17718 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:44555
I20260809 18:56:09.955399 17925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:44555 every 8 connection(s)
I20260809 18:56:09.956648 17718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:09.960481 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17718
I20260809 18:56:09.960685 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:09.961230 17139 external_mini_cluster.cc:1428] Setting key cc39935e7e4aab00ece80450647af143
Aug 09 18:56:09 dist-test-slave-266d krb5kdc[17153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301769, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:09.976426 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:09.959225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:51013 (local address 127.16.188.254:43443)
0809 18:56:09.959688 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:09.959694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:09.960667 (+ 973us) server_negotiation.cc:407] Connection header received
0809 18:56:09.962614 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:09.962619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:09.962700 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:09.962813 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:09.964543 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:09.965692 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:09.967133 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:09.967513 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:09.967609 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:09.970738 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:09.970743 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:09.970746 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:09.970779 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:09.973324 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:09.973980 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:09.973985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:09.973987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:09.974105 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:09.974628 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:09.974632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:09.974634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:09.974913 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:09.975054 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:09.975797 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 18:56:09.976011 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":213,"threads_started":1}
I20260809 18:56:09.977766 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:09.959778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43443 (local address 127.16.188.195:51013)
0809 18:56:09.960475 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:09.960511 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:09.962367 (+ 1856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:09.963036 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:09.963047 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:09.963755 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:09.964375 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:09.964392 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:09.965848 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:09.965852 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:09.967021 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:09.967034 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:09.967671 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:09.967675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:09.967883 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:09.968442 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:09.968462 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:09.970544 (+ 2082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:09.973447 (+ 2903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:09.973456 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:09.973470 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:09.973869 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:09.974208 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:09.974213 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:09.974217 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:09.974509 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:09.975071 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:09.975079 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:09.975423 (+ 344us) client_negotiation.cc:769] Sending connection context
0809 18:56:09.975695 (+ 272us) client_negotiation.cc:240] Negotiation successful
0809 18:56:09.976322 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":266,"threads_started":1}
I20260809 18:56:09.979023 17926 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43443
I20260809 18:56:09.979316 17926 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:09.979976 17926 heartbeater.cc:511] Master 127.16.188.254:43443 requested a full tablet report, sending...
I20260809 18:56:09.981287 17230 ts_manager.cc:194] Registered new tserver with Master: 2a90678bb53e4bb8891104c90fecdc21 (127.16.188.195:44555)
I20260809 18:56:09.982110 17230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:51013
I20260809 18:56:09.989609 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301770, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301770, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:10.033903 17943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:10.019367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50818 (local address 127.16.188.193:36887)
0809 18:56:10.020008 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:10.020017 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:10.020048 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:56:10.020120 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:10.020127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:10.020345 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:10.020486 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:10.021969 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.022960 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.024227 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.024783 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.024897 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:10.028704 (+ 3807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:10.028715 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:10.028729 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:10.028763 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:10.031502 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.032165 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.032172 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.032174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.032293 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.032575 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.032578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.032580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.032897 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:10.033173 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:10.033349 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 18:56:10.033543 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":295,"threads_started":1}
W20260809 18:56:10.035248 17377 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50818
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:10.076833 17943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:10.064463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50828 (local address 127.16.188.193:36887)
0809 18:56:10.064623 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:10.064628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:10.064985 (+ 357us) server_negotiation.cc:407] Connection header received
0809 18:56:10.065164 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:10.065168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:10.065268 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:10.065352 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:10.066552 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.067220 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.068332 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.068734 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.068822 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:10.072342 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:10.072347 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:10.072350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:10.072381 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:10.074812 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.075356 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.075361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.075363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.075496 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.075760 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.075763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.075765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.076003 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:10.076194 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:10.076424 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 18:56:10.076584 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:56:10.078601 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17318
I20260809 18:56:10.090634 17943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:10.079754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50840 (local address 127.16.188.193:36887)
0809 18:56:10.079939 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:10.079944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:10.080101 (+ 157us) server_negotiation.cc:407] Connection header received
0809 18:56:10.080238 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:10.080242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:10.080326 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:10.080401 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:10.081608 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.082300 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.083538 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.083959 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.084061 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:10.086190 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:10.086198 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:10.086203 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:10.086242 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:10.088620 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.089186 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.089190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.089192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.089314 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.089577 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.089580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.089582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.089805 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:10.089975 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:10.090170 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 18:56:10.090312 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 18:56:10.091446 17497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:10.178572 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17318
I20260809 18:56:10.203486 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17515
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:56:10.219182 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:10.204497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43582 (local address 127.16.188.194:38977)
0809 18:56:10.205058 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:10.205065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:10.205122 (+ 57us) server_negotiation.cc:407] Connection header received
0809 18:56:10.205259 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:10.205268 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:10.205490 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:10.205631 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:10.206697 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.207704 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.208942 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.209678 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.209787 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:10.213749 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:10.213760 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:10.213775 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:10.213810 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:10.216452 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.217067 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.217074 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.217076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.217233 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.217623 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.217628 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.217632 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.217981 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:10.218290 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:10.218584 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 18:56:10.218848 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":267,"threads_started":1}
I20260809 18:56:10.220415 17707 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:10.301440 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17515
I20260809 18:56:10.319871 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17718
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:56:10.339859 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:10.320958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38690 (local address 127.16.188.195:44555)
0809 18:56:10.321654 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:10.321661 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:10.321694 (+ 33us) server_negotiation.cc:407] Connection header received
0809 18:56:10.321759 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:10.321766 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:10.321979 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:10.322117 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:10.323323 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.324406 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.325754 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:10.326474 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:10.326620 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:10.334317 (+ 7697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:10.334333 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:10.334350 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:10.334393 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:10.337437 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.338050 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.338057 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.338060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.338175 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:10.338480 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:10.338484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:10.338486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:10.338846 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:10.339078 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:10.339277 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 18:56:10.339482 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":325,"threads_started":1}
I20260809 18:56:10.341187 17919 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:10.422161 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17718
I20260809 18:56:10.445225 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17177
I20260809 18:56:10.446372 17272 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:10.570180 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17177
2026-08-09T18:56:10Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4817 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17973](info): set up 2 sockets
Aug 09 18:56:10 dist-test-slave-266d krb5kdc[17973](info): commencing operation
krb5kdc: starting...
W20260809 18:56:11.756582 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.002s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:11 dist-test-slave-266d krb5kdc[17973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:11.927867 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:34285
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:34285
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:12.232765 17990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:12.233040 17990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:12.233186 17990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:12.240053 17990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:12.240159 17990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:12.240237 17990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:12.240317 17990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:12.240379 17990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:12.249671 17990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:34285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:34285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:12.250892 17990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:12.252171 17990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:12.262969 17996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:12.263352 17997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:12.263468 18000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:12.264314 17990 server_base.cc:1034] running on GCE node
I20260809 18:56:12.265038 17990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:12.266357 17990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:12.267558 17990 hybrid_clock.cc:648] HybridClock initialized: now 1786301772267503 us; error 40 us; skew 500 ppm
I20260809 18:56:12.267872 17990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:12 dist-test-slave-266d krb5kdc[17973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301772, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:12.273963 17990 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:12.275259 17990 webserver.cc:460] Webserver started at http://127.16.188.254:42811/ using document root <none> and password file <none>
I20260809 18:56:12.275899 17990 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:12.276013 17990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:12.276322 17990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:12.279222 17990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "4a0a5a01b0644086ba4949cf60e1451b"
format_stamp: "Formatted at 2026-08-09 18:56:12 on dist-test-slave-266d"
server_key: "75abe2b0e282fdbd975f2cb7936c6080"
server_key_iv: "562eccd30f8f9905db2bffae7f1e5152"
server_key_version: "encryptionkey@0"
I20260809 18:56:12.279932 17990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "4a0a5a01b0644086ba4949cf60e1451b"
format_stamp: "Formatted at 2026-08-09 18:56:12 on dist-test-slave-266d"
server_key: "75abe2b0e282fdbd975f2cb7936c6080"
server_key_iv: "562eccd30f8f9905db2bffae7f1e5152"
server_key_version: "encryptionkey@0"
I20260809 18:56:12.284749 17990 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 18:56:12.287847 18007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:12.289063 17990 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:12.289243 17990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "4a0a5a01b0644086ba4949cf60e1451b"
format_stamp: "Formatted at 2026-08-09 18:56:12 on dist-test-slave-266d"
server_key: "75abe2b0e282fdbd975f2cb7936c6080"
server_key_iv: "562eccd30f8f9905db2bffae7f1e5152"
server_key_version: "encryptionkey@0"
I20260809 18:56:12.289409 17990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:12.304347 17990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:12.308270 17990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:12.308514 17990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:12.325029 17990 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:34285
I20260809 18:56:12.325047 18092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:34285 every 8 connection(s)
I20260809 18:56:12.326261 17990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:12.329804 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:12.330590 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17990
I20260809 18:56:12.330828 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:12.331637 17139 external_mini_cluster.cc:1428] Setting key 5f81c89ac8a8d797bd75069db9464aaa
I20260809 18:56:12.343416 18093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b: Bootstrap starting.
Aug 09 18:56:12 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:12.346824 18093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:12.348121 18093 log.cc:824] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:12.351295 18093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b: No bootstrap required, opened a new log
I20260809 18:56:12.354763 18098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:12.333641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.16.188.254:34285)
0809 18:56:12.334392 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:12.334403 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:12.334447 (+ 44us) server_negotiation.cc:407] Connection header received
0809 18:56:12.336040 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:12.336061 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:12.336443 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:12.336752 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:12.338538 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:12.339803 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:12.341490 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:12.342152 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:12.342274 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:12.346673 (+ 4399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:12.346684 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:12.346707 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:12.346758 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:12.350369 (+ 3611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:12.351009 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:12.351018 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:12.351026 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:12.351225 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:12.351578 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:12.351583 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:12.351586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:12.352336 (+ 750us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:12.352635 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:12.352986 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 18:56:12.353464 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":336,"threads_started":1}
I20260809 18:56:12.359627 18093 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a0a5a01b0644086ba4949cf60e1451b" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34285 } }
I20260809 18:56:12.359964 18093 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:12.360054 18093 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0a5a01b0644086ba4949cf60e1451b, State: Initialized, Role: FOLLOWER
I20260809 18:56:12.360571 18093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a0a5a01b0644086ba4949cf60e1451b" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34285 } }
I20260809 18:56:12.360790 18093 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:12.360914 18093 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:12.361061 18093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:12.363090 18093 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a0a5a01b0644086ba4949cf60e1451b" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34285 } }
I20260809 18:56:12.363545 18093 leader_election.cc:302] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a0a5a01b0644086ba4949cf60e1451b; no voters:
I20260809 18:56:12.364089 18093 leader_election.cc:288] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:12.364207 18100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:12.364825 18100 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [term 1 LEADER]: Becoming Leader. State: Replica: 4a0a5a01b0644086ba4949cf60e1451b, State: Running, Role: LEADER
I20260809 18:56:12.365473 18100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a0a5a01b0644086ba4949cf60e1451b" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34285 } }
I20260809 18:56:12.366120 18093 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:12.368824 18102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a0a5a01b0644086ba4949cf60e1451b. Latest consensus state: current_term: 1 leader_uuid: "4a0a5a01b0644086ba4949cf60e1451b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a0a5a01b0644086ba4949cf60e1451b" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34285 } } }
I20260809 18:56:12.369243 18102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:12.368901 18101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a0a5a01b0644086ba4949cf60e1451b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a0a5a01b0644086ba4949cf60e1451b" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34285 } } }
I20260809 18:56:12.369457 18101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:12.370508 18113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:12.375648 18113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:12.383539 18113 catalog_manager.cc:1347] Generated new cluster ID: 132931cde78542409f64aec2623af855
I20260809 18:56:12.383637 18113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:12.407399 18113 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:12.409292 18113 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:12.417546 18113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a0a5a01b0644086ba4949cf60e1451b: Generated new TSK 0
I20260809 18:56:12.418498 18113 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:12.466459 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34285
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:12.796995 18130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:12.797333 18130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:12.797494 18130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:12.804690 18130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:12.804800 18130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:12.804961 18130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:12.814854 18130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34285
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:12.816176 18130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:12.817680 18130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:12.831037 18141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:12.831215 18140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:12.831077 18148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:12.831861 18130 server_base.cc:1034] running on GCE node
I20260809 18:56:12.832448 18130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:12.833415 18130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:12.834602 18130 hybrid_clock.cc:648] HybridClock initialized: now 1786301772834556 us; error 40 us; skew 500 ppm
I20260809 18:56:12.834894 18130 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:12 dist-test-slave-266d krb5kdc[17973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301772, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:12.837929 18130 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:12.839411 18130 webserver.cc:460] Webserver started at http://127.16.188.193:36683/ using document root <none> and password file <none>
I20260809 18:56:12.840041 18130 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:12.840149 18130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:12.840444 18130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:12.843259 18130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf"
format_stamp: "Formatted at 2026-08-09 18:56:12 on dist-test-slave-266d"
server_key: "227910c308d25e2664ca53ffb416202c"
server_key_iv: "25f228ab57f73323875915f4486eaba8"
server_key_version: "encryptionkey@0"
I20260809 18:56:12.843994 18130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf"
format_stamp: "Formatted at 2026-08-09 18:56:12 on dist-test-slave-266d"
server_key: "227910c308d25e2664ca53ffb416202c"
server_key_iv: "25f228ab57f73323875915f4486eaba8"
server_key_version: "encryptionkey@0"
I20260809 18:56:12.848688 18130 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 18:56:12.851889 18156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:12.853109 18130 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 18:56:12.853263 18130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf"
format_stamp: "Formatted at 2026-08-09 18:56:12 on dist-test-slave-266d"
server_key: "227910c308d25e2664ca53ffb416202c"
server_key_iv: "25f228ab57f73323875915f4486eaba8"
server_key_version: "encryptionkey@0"
I20260809 18:56:12.853420 18130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:12.866883 18130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:12.870584 18130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:12.870834 18130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:12.871771 18130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:12.873003 18130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:12.873071 18130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:12.873219 18130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:12.873281 18130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:12.902623 18130 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:38963
I20260809 18:56:12.902673 18317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:38963 every 8 connection(s)
I20260809 18:56:12.903843 18130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:12.912401 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18130
I20260809 18:56:12.912595 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:12.913213 17139 external_mini_cluster.cc:1428] Setting key 08533ae922f8740c4ee079d59e3c0a06
Aug 09 18:56:12 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301772, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:12.923054 18321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:12.906286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:44455 (local address 127.16.188.254:34285)
0809 18:56:12.906696 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:12.906701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:12.907684 (+ 983us) server_negotiation.cc:407] Connection header received
0809 18:56:12.909482 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:12.909489 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:12.909572 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:12.909667 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:12.911113 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:12.911835 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:12.913453 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:12.913919 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:12.914037 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:12.917319 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:12.917324 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:12.917329 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:12.917374 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:12.920206 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:12.920887 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:12.920892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:12.920895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:12.921038 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:12.921511 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:12.921515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:12.921517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:12.921782 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:12.921889 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:12.922632 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 18:56:12.922814 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":195,"threads_started":1}
I20260809 18:56:12.924266 18324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:12.906836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:34285 (local address 127.16.188.193:44455)
0809 18:56:12.907525 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:12.907568 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:12.909219 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:12.909912 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:12.909919 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:12.910396 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:12.910942 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:12.910960 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:12.911981 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:12.911985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:12.913325 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:12.913338 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:12.914122 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:12.914131 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:12.914356 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:12.914984 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:12.915007 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:12.917057 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:12.920352 (+ 3295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:12.920360 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:12.920370 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:12.920766 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:12.921156 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:12.921161 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:12.921164 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:12.921397 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:12.921896 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:12.921903 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:12.922301 (+ 398us) client_negotiation.cc:769] Sending connection context
0809 18:56:12.922571 (+ 270us) client_negotiation.cc:240] Negotiation successful
0809 18:56:12.923048 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":270,"threads_started":1}
I20260809 18:56:12.925710 18318 heartbeater.cc:347] Connected to a master server at 127.16.188.254:34285
I20260809 18:56:12.925995 18318 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:12.926668 18318 heartbeater.cc:511] Master 127.16.188.254:34285 requested a full tablet report, sending...
I20260809 18:56:12.928624 18037 ts_manager.cc:194] Registered new tserver with Master: 5beea3a3e8524bd2a1ecc4ea2f414bcf (127.16.188.193:38963)
I20260809 18:56:12.930018 18037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:44455
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:12.953753 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34285
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:13.269580 18327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:13.269840 18327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:13.269942 18327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:13.276953 18327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:13.277055 18327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:13.277199 18327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:13.286331 18327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34285
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:13.287515 18327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:13.288803 18327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:13.301333 18341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:13.301306 18338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:13.301397 18337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:13.301652 18327 server_base.cc:1034] running on GCE node
I20260809 18:56:13.302441 18327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:13.303288 18327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:13.304481 18327 hybrid_clock.cc:648] HybridClock initialized: now 1786301773304438 us; error 32 us; skew 500 ppm
I20260809 18:56:13.304756 18327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:13 dist-test-slave-266d krb5kdc[17973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301773, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:13.307822 18327 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:13.309193 18327 webserver.cc:460] Webserver started at http://127.16.188.194:45941/ using document root <none> and password file <none>
I20260809 18:56:13.309866 18327 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:13.309970 18327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:13.310228 18327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:13.312958 18327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "9ec4682241b347bcb003e04199677ec5"
format_stamp: "Formatted at 2026-08-09 18:56:13 on dist-test-slave-266d"
server_key: "349670e13e379c414d406ea504848321"
server_key_iv: "eb875c17469e42e5800e6340abb971ae"
server_key_version: "encryptionkey@0"
I20260809 18:56:13.313724 18327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "9ec4682241b347bcb003e04199677ec5"
format_stamp: "Formatted at 2026-08-09 18:56:13 on dist-test-slave-266d"
server_key: "349670e13e379c414d406ea504848321"
server_key_iv: "eb875c17469e42e5800e6340abb971ae"
server_key_version: "encryptionkey@0"
I20260809 18:56:13.318496 18327 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 18:56:13.321692 18353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:13.322921 18327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:13.323061 18327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "9ec4682241b347bcb003e04199677ec5"
format_stamp: "Formatted at 2026-08-09 18:56:13 on dist-test-slave-266d"
server_key: "349670e13e379c414d406ea504848321"
server_key_iv: "eb875c17469e42e5800e6340abb971ae"
server_key_version: "encryptionkey@0"
I20260809 18:56:13.323236 18327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:13.338829 18327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:13.342592 18327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:13.342855 18327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:13.343779 18327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:13.345079 18327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:13.345186 18327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:13.345285 18327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:13.345332 18327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:13.376072 18327 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:39275
I20260809 18:56:13.376097 18518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:39275 every 8 connection(s)
I20260809 18:56:13.377393 18327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:13.378113 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18327
I20260809 18:56:13.378309 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:13.378858 17139 external_mini_cluster.cc:1428] Setting key 1ebc5acb141db66b676a448f2eaea90b
Aug 09 18:56:13 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301773, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
I20260809 18:56:13.397529 18321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:13.380088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:41193 (local address 127.16.188.254:34285)
0809 18:56:13.380289 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:13.380295 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:13.381539 (+ 1244us) server_negotiation.cc:407] Connection header received
0809 18:56:13.383353 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:13.383359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:13.383454 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:13.383541 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:13.385023 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:13.385787 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:13.387299 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:13.387695 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:13.387803 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:13.391459 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:13.391464 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:13.391467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:13.391498 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:13.394665 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:13.395336 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:13.395341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:13.395345 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:13.395507 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:13.395889 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:13.395894 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:13.395898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:13.396251 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:13.396422 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:13.397050 (+ 628us) server_negotiation.cc:299] Negotiation successful
0809 18:56:13.397297 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 18:56:13.398492 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:13.380630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:34285 (local address 127.16.188.194:41193)
0809 18:56:13.381401 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:13.381439 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:13.383101 (+ 1662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:13.383791 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:13.383800 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:13.384290 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:13.384857 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:13.384875 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:13.385947 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:13.385951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:13.387157 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:13.387171 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:13.387909 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:13.387916 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:13.388138 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:13.388749 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:13.388771 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:13.391223 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:13.394794 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:13.394801 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:13.394813 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:13.395223 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:13.395607 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:13.395610 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:13.395612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:13.395785 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:13.396372 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:13.396377 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:13.396675 (+ 298us) client_negotiation.cc:769] Sending connection context
0809 18:56:13.396899 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 18:56:13.397351 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":294,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
I20260809 18:56:13.399914 18519 heartbeater.cc:347] Connected to a master server at 127.16.188.254:34285
I20260809 18:56:13.400211 18519 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:13.400908 18519 heartbeater.cc:511] Master 127.16.188.254:34285 requested a full tablet report, sending...
I20260809 18:56:13.402475 18037 ts_manager.cc:194] Registered new tserver with Master: 9ec4682241b347bcb003e04199677ec5 (127.16.188.194:39275)
I20260809 18:56:13.403486 18037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:41193
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:56:13.420197 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34285
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:13.797907 18527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:13.798208 18527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:13.798357 18527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:13.807044 18527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:13.807247 18527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:13.807466 18527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:13.819455 18527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34285
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:13.820905 18527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:13.822707 18527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:13.839274 18537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:13.839952 18539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:13.841158 18527 server_base.cc:1034] running on GCE node
W20260809 18:56:13.843205 18535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:13.844058 18527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:13.845373 18527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:13.846665 18527 hybrid_clock.cc:648] HybridClock initialized: now 1786301773846597 us; error 51 us; skew 500 ppm
I20260809 18:56:13.847086 18527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:13 dist-test-slave-266d krb5kdc[17973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301773, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:13.850665 18527 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:13.852070 18527 webserver.cc:460] Webserver started at http://127.16.188.195:46355/ using document root <none> and password file <none>
I20260809 18:56:13.852722 18527 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:13.852835 18527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:13.853173 18527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:13.856490 18527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "974ffaaed2054fc6b131306d1afd5946"
format_stamp: "Formatted at 2026-08-09 18:56:13 on dist-test-slave-266d"
server_key: "5c178dd37febd11d702bfae7d0027375"
server_key_iv: "62182cd57254f33fd1686b2d4c48fcd9"
server_key_version: "encryptionkey@0"
I20260809 18:56:13.857383 18527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "974ffaaed2054fc6b131306d1afd5946"
format_stamp: "Formatted at 2026-08-09 18:56:13 on dist-test-slave-266d"
server_key: "5c178dd37febd11d702bfae7d0027375"
server_key_iv: "62182cd57254f33fd1686b2d4c48fcd9"
server_key_version: "encryptionkey@0"
I20260809 18:56:13.862596 18527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:56:13.866425 18550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:13.867659 18527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 18:56:13.867825 18527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "974ffaaed2054fc6b131306d1afd5946"
format_stamp: "Formatted at 2026-08-09 18:56:13 on dist-test-slave-266d"
server_key: "5c178dd37febd11d702bfae7d0027375"
server_key_iv: "62182cd57254f33fd1686b2d4c48fcd9"
server_key_version: "encryptionkey@0"
I20260809 18:56:13.868024 18527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:13.886195 18527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:13.890617 18527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:13.890903 18527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:13.891856 18527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:13.893400 18527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:13.893484 18527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:13.893621 18527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:13.893679 18527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:13.932717 18318 heartbeater.cc:503] Master 127.16.188.254:34285 was elected leader, sending a full tablet report...
I20260809 18:56:13.941329 18527 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:37799
I20260809 18:56:13.941500 18707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:37799 every 8 connection(s)
I20260809 18:56:13.942857 18527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:13.946684 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18527
I20260809 18:56:13.946957 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:13.947484 17139 external_mini_cluster.cc:1428] Setting key 763da7f955c1fb375a01d0cdfa28595f
Aug 09 18:56:13 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301773, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:13.969348 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:13.946246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:50197 (local address 127.16.188.254:34285)
0809 18:56:13.947037 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:13.947044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:13.948560 (+ 1516us) server_negotiation.cc:407] Connection header received
0809 18:56:13.951381 (+ 2821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:13.951386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:13.951448 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:13.951532 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:13.953416 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:13.954468 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:13.956476 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:13.957411 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:13.957508 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:13.962274 (+ 4766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:13.962282 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:13.962287 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:13.962330 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:13.966205 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:13.966830 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:13.966833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:13.966836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:13.967009 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:13.967449 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:13.967453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:13.967455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:13.967836 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:13.967959 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:13.968740 (+ 781us) server_negotiation.cc:299] Negotiation successful
0809 18:56:13.968901 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":460,"threads_started":1}
I20260809 18:56:13.970249 18713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:13.946999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:34285 (local address 127.16.188.195:50197)
0809 18:56:13.948367 (+ 1368us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:13.948451 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:13.951141 (+ 2690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:13.951780 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:13.951787 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:13.952481 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:13.953275 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:13.953298 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:13.954616 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:13.954620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:13.956303 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:13.956333 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:13.957711 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:13.957722 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:13.958078 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:13.958903 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:13.958929 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:13.962026 (+ 3097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:13.966325 (+ 4299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:13.966331 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:13.966342 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:13.966728 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:13.967114 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:13.967118 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:13.967120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:13.967354 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:13.967943 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:13.967948 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:13.968311 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 18:56:13.968553 (+ 242us) client_negotiation.cc:240] Negotiation successful
0809 18:56:13.968949 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1045,"thread_start_us":690,"threads_started":1}
I20260809 18:56:13.971583 18708 heartbeater.cc:347] Connected to a master server at 127.16.188.254:34285
I20260809 18:56:13.971967 18708 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:13.973115 18708 heartbeater.cc:511] Master 127.16.188.254:34285 requested a full tablet report, sending...
I20260809 18:56:13.974844 18037 ts_manager.cc:194] Registered new tserver with Master: 974ffaaed2054fc6b131306d1afd5946 (127.16.188.195:37799)
I20260809 18:56:13.975792 18037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:50197
I20260809 18:56:13.987123 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:56:14.011770 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:13.995546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57490 (local address 127.16.188.254:34285)
0809 18:56:13.995723 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:13.995729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:13.996690 (+ 961us) server_negotiation.cc:407] Connection header received
0809 18:56:13.996818 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:13.996821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:13.996878 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:13.996949 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:13.999463 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.000354 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.001976 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.002526 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.002616 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.005622 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:14.005626 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:14.005629 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:14.005655 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:14.009075 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.009782 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.009785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.009788 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.009931 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.010284 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.010287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.010289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.010671 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:14.010903 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.011281 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.011438 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:56:14.020637 18037 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57490:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:14.032631 18037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:14.064705 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.050524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33260 (local address 127.16.188.194:39275)
0809 18:56:14.051375 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.051381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.051585 (+ 204us) server_negotiation.cc:407] Connection header received
0809 18:56:14.052383 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.052395 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.052668 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.052955 (+ 287us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:14.055173 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.057240 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.061038 (+ 3798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.063049 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.063575 (+ 526us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.063783 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.064024 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.064206 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":469,"threads_started":1}
I20260809 18:56:14.064937 18730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.050297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:39275 (local address 127.0.0.1:33260)
0809 18:56:14.051460 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:14.051500 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:14.051756 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:14.053397 (+ 1641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:14.053405 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:14.053443 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:14.054909 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.054921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.057460 (+ 2539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.057466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.060787 (+ 3321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.060805 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.063359 (+ 2554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.063368 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.063714 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.063793 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 18:56:14.063954 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 18:56:14.064133 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"mutex_wait_us":24,"thread_start_us":618,"threads_started":1}
I20260809 18:56:14.067752 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.053924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56378 (local address 127.16.188.193:38963)
0809 18:56:14.054917 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.054923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.056571 (+ 1648us) server_negotiation.cc:407] Connection header received
0809 18:56:14.056686 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.056693 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.056952 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.057231 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:14.058627 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.060289 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.063085 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.065864 (+ 2779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.066425 (+ 561us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.066570 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.067071 (+ 501us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.067251 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":818,"thread_start_us":595,"threads_started":1}
I20260809 18:56:14.068558 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.052314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34288 (local address 127.16.188.195:37799)
0809 18:56:14.054610 (+ 2296us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.054622 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.055566 (+ 944us) server_negotiation.cc:407] Connection header received
0809 18:56:14.055685 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.055694 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.056017 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.056230 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:14.058523 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.060636 (+ 2113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.064118 (+ 3482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.065863 (+ 1745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.066142 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.066538 (+ 396us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.067667 (+ 1129us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.067872 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1978,"thread_start_us":1731,"threads_started":1}
I20260809 18:56:14.068871 18736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.053725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:38963 (local address 127.0.0.1:56378)
0809 18:56:14.056327 (+ 2602us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:14.056344 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:14.056455 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:14.057180 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:14.057184 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:14.057211 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:14.058414 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.058426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.060478 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.060483 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.062943 (+ 2460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.062956 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.066648 (+ 3692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.066656 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.066904 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.066929 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 18:56:14.067011 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 18:56:14.067126 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2430,"mutex_wait_us":98,"thread_start_us":2018,"threads_started":1}
I20260809 18:56:14.069473 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.051694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:37799 (local address 127.0.0.1:34288)
0809 18:56:14.055231 (+ 3537us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:14.055253 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:14.055418 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:14.056810 (+ 1392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:14.056816 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:14.056845 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:14.058208 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.058225 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.060819 (+ 2594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.060824 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.063892 (+ 3068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.063909 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.066794 (+ 2885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.066806 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.067157 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.067195 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 18:56:14.067286 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 18:56:14.067460 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3332,"mutex_wait_us":6,"thread_start_us":1604,"threads_started":1}
I20260809 18:56:14.070566 18421 tablet_service.cc:1467] Processing CreateTablet for tablet 3cedc0b212834b009619d335d865cdf1 (DEFAULT_TABLE table=test-table [id=1f5990eb163846d9bbc11247fb7b4396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:14.072445 18421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cedc0b212834b009619d335d865cdf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:14.072589 18228 tablet_service.cc:1467] Processing CreateTablet for tablet 3cedc0b212834b009619d335d865cdf1 (DEFAULT_TABLE table=test-table [id=1f5990eb163846d9bbc11247fb7b4396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:14.073992 18228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cedc0b212834b009619d335d865cdf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:14.073865 18618 tablet_service.cc:1467] Processing CreateTablet for tablet 3cedc0b212834b009619d335d865cdf1 (DEFAULT_TABLE table=test-table [id=1f5990eb163846d9bbc11247fb7b4396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:14.075176 18618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cedc0b212834b009619d335d865cdf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:14.085237 18737 tablet_bootstrap.cc:492] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5: Bootstrap starting.
I20260809 18:56:14.088179 18737 tablet_bootstrap.cc:654] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:14.088835 18739 tablet_bootstrap.cc:492] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf: Bootstrap starting.
I20260809 18:56:14.089768 18737 log.cc:824] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:14.092645 18739 tablet_bootstrap.cc:654] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:14.093217 18737 tablet_bootstrap.cc:492] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5: No bootstrap required, opened a new log
I20260809 18:56:14.093501 18737 ts_tablet_manager.cc:1397] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 18:56:14.094025 18739 log.cc:824] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:14.094838 18740 tablet_bootstrap.cc:492] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946: Bootstrap starting.
I20260809 18:56:14.096370 18739 tablet_bootstrap.cc:492] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf: No bootstrap required, opened a new log
I20260809 18:56:14.096601 18739 ts_tablet_manager.cc:1397] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 18:56:14.098446 18740 tablet_bootstrap.cc:654] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:14.099679 18740 log.cc:824] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:14.102761 18740 tablet_bootstrap.cc:492] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946: No bootstrap required, opened a new log
I20260809 18:56:14.103056 18740 ts_tablet_manager.cc:1397] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260809 18:56:14.104547 18737 raft_consensus.cc:348] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.105185 18737 raft_consensus.cc:374] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:14.105368 18737 raft_consensus.cc:729] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ec4682241b347bcb003e04199677ec5, State: Initialized, Role: FOLLOWER
I20260809 18:56:14.105373 18739 raft_consensus.cc:348] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.105872 18739 raft_consensus.cc:374] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:14.106024 18739 raft_consensus.cc:729] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5beea3a3e8524bd2a1ecc4ea2f414bcf, State: Initialized, Role: FOLLOWER
I20260809 18:56:14.106150 18737 consensus_queue.cc:260] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.106629 18739 consensus_queue.cc:260] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.108116 18519 heartbeater.cc:503] Master 127.16.188.254:34285 was elected leader, sending a full tablet report...
I20260809 18:56:14.108608 18737 ts_tablet_manager.cc:1428] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5: Time spent starting tablet: real 0.015s user 0.007s sys 0.007s
I20260809 18:56:14.110911 18739 ts_tablet_manager.cc:1428] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf: Time spent starting tablet: real 0.014s user 0.007s sys 0.007s
I20260809 18:56:14.117022 18740 raft_consensus.cc:348] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.117547 18740 raft_consensus.cc:374] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:14.117702 18740 raft_consensus.cc:729] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ffaaed2054fc6b131306d1afd5946, State: Initialized, Role: FOLLOWER
I20260809 18:56:14.118350 18740 consensus_queue.cc:260] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.119801 18708 heartbeater.cc:503] Master 127.16.188.254:34285 was elected leader, sending a full tablet report...
I20260809 18:56:14.121498 18740 ts_tablet_manager.cc:1428] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946: Time spent starting tablet: real 0.018s user 0.014s sys 0.005s
W20260809 18:56:14.129405 18521 tablet.cc:2369] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:56:14.156088 18320 tablet.cc:2369] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:56:14.195518 18710 tablet.cc:2369] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:14.281343 18753 raft_consensus.cc:482] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:14.281786 18753 raft_consensus.cc:504] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.284513 18753 leader_election.cc:288] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ec4682241b347bcb003e04199677ec5 (127.16.188.194:39275), 974ffaaed2054fc6b131306d1afd5946 (127.16.188.195:37799)
I20260809 18:56:14.295177 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.285229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:43765 (local address 127.16.188.194:39275)
0809 18:56:14.285478 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.285483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.286661 (+ 1178us) server_negotiation.cc:407] Connection header received
0809 18:56:14.286913 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.286919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.287004 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.287114 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:14.288362 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.289632 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.292441 (+ 2809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.294099 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.294214 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.294269 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.294829 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.294914 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 18:56:14.295519 18756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.285013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:39275 (local address 127.16.188.193:43765)
0809 18:56:14.286543 (+ 1530us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:14.286563 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:14.286743 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:14.287349 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:14.287353 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:14.287383 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:14.288142 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.288158 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.289796 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.289801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.292285 (+ 2484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.292298 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.294420 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.294428 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.294682 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.294719 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 18:56:14.294815 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 18:56:14.294943 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1363,"thread_start_us":950,"threads_started":1}
I20260809 18:56:14.296722 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.287034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:37993 (local address 127.16.188.195:37799)
0809 18:56:14.287296 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.287302 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.288013 (+ 711us) server_negotiation.cc:407] Connection header received
0809 18:56:14.288283 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.288290 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.288370 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.288446 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:14.289606 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.291096 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.294117 (+ 3021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.295674 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.295852 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.295930 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.296335 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.296453 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 18:56:14.296957 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.286640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:37799 (local address 127.16.188.193:37993)
0809 18:56:14.287910 (+ 1270us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:14.287928 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:14.288080 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:14.288471 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:14.288475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:14.288499 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:14.289441 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.289454 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.291234 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.291237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.293938 (+ 2701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:14.293954 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.295985 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.295992 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:14.296169 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.296193 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 18:56:14.296274 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 18:56:14.296404 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"thread_start_us":658,"threads_started":1}
I20260809 18:56:14.296862 18444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cedc0b212834b009619d335d865cdf1" candidate_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ec4682241b347bcb003e04199677ec5" is_pre_election: true
I20260809 18:56:14.297987 18444 raft_consensus.cc:2454] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5beea3a3e8524bd2a1ecc4ea2f414bcf in term 0.
I20260809 18:56:14.298918 18161 leader_election.cc:302] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5beea3a3e8524bd2a1ecc4ea2f414bcf, 9ec4682241b347bcb003e04199677ec5; no voters:
I20260809 18:56:14.299117 18647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cedc0b212834b009619d335d865cdf1" candidate_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ffaaed2054fc6b131306d1afd5946" is_pre_election: true
I20260809 18:56:14.299396 18753 raft_consensus.cc:2781] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:14.299546 18753 raft_consensus.cc:482] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:14.299731 18753 raft_consensus.cc:3037] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:14.299763 18647 raft_consensus.cc:2454] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5beea3a3e8524bd2a1ecc4ea2f414bcf in term 0.
I20260809 18:56:14.303133 18753 raft_consensus.cc:504] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.303879 18753 leader_election.cc:288] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [CANDIDATE]: Term 1 election: Requested vote from peers 9ec4682241b347bcb003e04199677ec5 (127.16.188.194:39275), 974ffaaed2054fc6b131306d1afd5946 (127.16.188.195:37799)
I20260809 18:56:14.304276 18444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cedc0b212834b009619d335d865cdf1" candidate_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ec4682241b347bcb003e04199677ec5"
I20260809 18:56:14.304455 18647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cedc0b212834b009619d335d865cdf1" candidate_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ffaaed2054fc6b131306d1afd5946"
I20260809 18:56:14.304507 18444 raft_consensus.cc:3037] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:14.304689 18647 raft_consensus.cc:3037] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:14.307638 18647 raft_consensus.cc:2454] T 3cedc0b212834b009619d335d865cdf1 P 974ffaaed2054fc6b131306d1afd5946 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5beea3a3e8524bd2a1ecc4ea2f414bcf in term 1.
I20260809 18:56:14.307631 18444 raft_consensus.cc:2454] T 3cedc0b212834b009619d335d865cdf1 P 9ec4682241b347bcb003e04199677ec5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5beea3a3e8524bd2a1ecc4ea2f414bcf in term 1.
I20260809 18:56:14.308033 18161 leader_election.cc:302] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5beea3a3e8524bd2a1ecc4ea2f414bcf, 9ec4682241b347bcb003e04199677ec5; no voters:
I20260809 18:56:14.308348 18753 raft_consensus.cc:2781] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:14.309165 18753 raft_consensus.cc:686] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [term 1 LEADER]: Becoming Leader. State: Replica: 5beea3a3e8524bd2a1ecc4ea2f414bcf, State: Running, Role: LEADER
I20260809 18:56:14.309705 18753 consensus_queue.cc:237] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } }
I20260809 18:56:14.315295 18037 catalog_manager.cc:5495] T 3cedc0b212834b009619d335d865cdf1 P 5beea3a3e8524bd2a1ecc4ea2f414bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5beea3a3e8524bd2a1ecc4ea2f414bcf (127.16.188.193). New cstate: current_term: 1 leader_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ec4682241b347bcb003e04199677ec5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ffaaed2054fc6b131306d1afd5946" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 37799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5beea3a3e8524bd2a1ecc4ea2f414bcf" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38963 } health_report { overall_health: HEALTHY } } }
Aug 09 18:56:14 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:14.367640 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.348537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56380 (local address 127.16.188.193:38963)
0809 18:56:14.348770 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.348774 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.349642 (+ 868us) server_negotiation.cc:407] Connection header received
0809 18:56:14.349803 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.349806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.349871 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.349949 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:14.352469 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.353201 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.354914 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.355325 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.355412 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.360881 (+ 5469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:14.360896 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:14.360914 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:14.360955 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:14.364298 (+ 3343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.364951 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.364958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.364960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.365314 (+ 354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.365822 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.365826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.365828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.366315 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:14.366615 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.366876 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.367193 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 18:56:14 dist-test-slave-266d krb5kdc[17973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301774, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:56:14 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301774, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:14.423358 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.405586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56382 (local address 127.16.188.193:38963)
0809 18:56:14.405779 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.405786 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.406279 (+ 493us) server_negotiation.cc:407] Connection header received
0809 18:56:14.406487 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.406491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.406558 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.406642 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:14.408800 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.409722 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.411242 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.411847 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.411961 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.417008 (+ 5047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:14.417013 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:14.417016 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:14.417049 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:14.420419 (+ 3370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.420985 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.420989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.420991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.421246 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.421686 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.421692 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.421695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.422016 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:14.422416 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.422617 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.422861 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 18:56:14 dist-test-slave-266d krb5kdc[17973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:56:14 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:14.473198 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.455174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56386 (local address 127.16.188.193:38963)
0809 18:56:14.455382 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.455389 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.455700 (+ 311us) server_negotiation.cc:407] Connection header received
0809 18:56:14.455894 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.455898 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.456015 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.456106 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:14.458208 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.459329 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.461018 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.461729 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.461844 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.466988 (+ 5144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:14.466993 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:14.466996 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:14.467037 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:14.470619 (+ 3582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.471458 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.471462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.471465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.471598 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.471931 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.471934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.471936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.472241 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:14.472430 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.472726 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.472909 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 18:56:14.475610 18195 tablet_service.cc:2908] Rejecting scan request for tablet 3cedc0b212834b009619d335d865cdf1: Uninitialized: clean time has not yet been initialized
I20260809 18:56:14.478958 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18130
I20260809 18:56:14.492349 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.479740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56402 (local address 127.16.188.193:38963)
0809 18:56:14.479882 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.479886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.480257 (+ 371us) server_negotiation.cc:407] Connection header received
0809 18:56:14.480376 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.480379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.480430 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.480499 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:14.481541 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.482201 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.483280 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.483660 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.483748 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.486485 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:14.486489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:14.486492 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:14.486519 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:14.489699 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.490419 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.490423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.490425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.490590 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.490938 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.490940 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.490942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.491236 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:14.491526 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.491692 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.491933 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 18:56:14.493207 18312 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:14.586311 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18130
I20260809 18:56:14.612787 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18327
Aug 09 18:56:14 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:56:14.628052 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.613541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33262 (local address 127.16.188.194:39275)
0809 18:56:14.613715 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.613719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.613789 (+ 70us) server_negotiation.cc:407] Connection header received
0809 18:56:14.613945 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.613949 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.614011 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.614106 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:14.615339 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.616035 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.617516 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.617892 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.617985 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.621982 (+ 3997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:14.621995 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:14.622010 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:14.622044 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:14.625258 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.625914 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.625922 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.625924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.626113 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.626481 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.626485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.626487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.626909 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:14.627204 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.627521 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.627743 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:56:14.628698 18512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:14.714747 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18327
I20260809 18:56:14.738649 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18527
Aug 09 18:56:14 dist-test-slave-266d krb5kdc[17973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:56:14.754148 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:14.739434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34290 (local address 127.16.188.195:37799)
0809 18:56:14.739607 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:14.739612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:14.739631 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:56:14.739778 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:14.739782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:14.739856 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:14.739936 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:14.741083 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.741825 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.743051 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:14.743435 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:14.743523 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:14.748209 (+ 4686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:14.748226 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:14.748243 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:14.748276 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:14.751345 (+ 3069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.751942 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.751949 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.751951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.752143 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:14.752435 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:14.752438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:14.752440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:14.752897 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:14.753257 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:14.753426 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 18:56:14.753673 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 18:56:14.754834 18702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:14.840993 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18527
I20260809 18:56:14.864810 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17990
I20260809 18:56:14.865938 18081 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:14.972873 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17990
2026-08-09T18:56:14Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4401 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:15 dist-test-slave-266d krb5kdc[18790](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:15 dist-test-slave-266d krb5kdc[18790](info): set up 2 sockets
Aug 09 18:56:15 dist-test-slave-266d krb5kdc[18790](info): commencing operation
krb5kdc: starting...
W20260809 18:56:16.165472 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:16 dist-test-slave-266d krb5kdc[18790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:16.336273 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:44655
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:44655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:16.645414 18812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:16.645663 18812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:16.645753 18812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:16.652539 18812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:16.652626 18812 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:56:16.652673 18812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:16.652729 18812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:16.652777 18812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:16.652835 18812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:16.662108 18812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:44655
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:44655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:16.663195 18812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:16.664403 18812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:16.675400 18818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:16.675360 18819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:16.675436 18823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:16.676236 18812 server_base.cc:1034] running on GCE node
I20260809 18:56:16.676908 18812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:16.678169 18812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:16.679378 18812 hybrid_clock.cc:648] HybridClock initialized: now 1786301776679320 us; error 36 us; skew 500 ppm
I20260809 18:56:16.679667 18812 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:16 dist-test-slave-266d krb5kdc[18790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301776, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:16.682585 18812 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:16.683938 18812 webserver.cc:460] Webserver started at http://127.16.188.254:44231/ using document root <none> and password file <none>
I20260809 18:56:16.684557 18812 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:16.684640 18812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:16.684900 18812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:16.687661 18812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "2b17abca59094372ac1fa699ff872678"
format_stamp: "Formatted at 2026-08-09 18:56:16 on dist-test-slave-266d"
server_key: "646ef4e4c34ec0cd9d74f4aa36f1dbcc"
server_key_iv: "8f2ac903094b5fc6ad12ab08aae41c02"
server_key_version: "encryptionkey@0"
I20260809 18:56:16.688352 18812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "2b17abca59094372ac1fa699ff872678"
format_stamp: "Formatted at 2026-08-09 18:56:16 on dist-test-slave-266d"
server_key: "646ef4e4c34ec0cd9d74f4aa36f1dbcc"
server_key_iv: "8f2ac903094b5fc6ad12ab08aae41c02"
server_key_version: "encryptionkey@0"
I20260809 18:56:16.693035 18812 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 18:56:16.696151 18831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:16.697409 18812 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 18:56:16.697548 18812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "2b17abca59094372ac1fa699ff872678"
format_stamp: "Formatted at 2026-08-09 18:56:16 on dist-test-slave-266d"
server_key: "646ef4e4c34ec0cd9d74f4aa36f1dbcc"
server_key_iv: "8f2ac903094b5fc6ad12ab08aae41c02"
server_key_version: "encryptionkey@0"
I20260809 18:56:16.697710 18812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:16.710178 18812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:16.713765 18812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:16.713973 18812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:16.734974 18812 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:44655
I20260809 18:56:16.734987 18915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:44655 every 8 connection(s)
I20260809 18:56:16.736299 18812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:16.739740 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18812
I20260809 18:56:16.739986 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:16.740383 18916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:16.740839 17139 external_mini_cluster.cc:1428] Setting key 4e44decee964eae7b75ede801cdbf1e6
I20260809 18:56:16.754455 18916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678: Bootstrap starting.
Aug 09 18:56:16 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:16.757656 18916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:16.758677 18916 log.cc:824] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:16.761270 18916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678: No bootstrap required, opened a new log
I20260809 18:56:16.762488 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:16.742855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55102 (local address 127.16.188.254:44655)
0809 18:56:16.743620 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:16.743631 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:16.743673 (+ 42us) server_negotiation.cc:407] Connection header received
0809 18:56:16.745267 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:16.745288 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:16.745630 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:16.745948 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:16.747577 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:16.748844 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:16.750529 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:16.751202 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:16.751338 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:16.755840 (+ 4502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:16.755848 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:16.755861 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:16.755905 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:16.758789 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:16.759406 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:16.759412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:16.759421 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:16.759598 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:16.759935 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:16.759938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:16.759941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:16.760430 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:16.760694 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:16.761142 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 18:56:16.761551 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":332,"threads_started":1}
I20260809 18:56:16.768384 18916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b17abca59094372ac1fa699ff872678" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44655 } }
I20260809 18:56:16.768710 18916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:16.768806 18916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b17abca59094372ac1fa699ff872678, State: Initialized, Role: FOLLOWER
I20260809 18:56:16.769390 18916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b17abca59094372ac1fa699ff872678" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44655 } }
I20260809 18:56:16.769618 18916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:16.769740 18916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:16.769894 18916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:16.771839 18916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b17abca59094372ac1fa699ff872678" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44655 } }
I20260809 18:56:16.772305 18916 leader_election.cc:302] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b17abca59094372ac1fa699ff872678; no voters:
I20260809 18:56:16.772866 18916 leader_election.cc:288] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:16.772955 18922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:16.773754 18922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [term 1 LEADER]: Becoming Leader. State: Replica: 2b17abca59094372ac1fa699ff872678, State: Running, Role: LEADER
I20260809 18:56:16.774245 18922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b17abca59094372ac1fa699ff872678" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44655 } }
I20260809 18:56:16.774940 18916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:16.777200 18925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b17abca59094372ac1fa699ff872678. Latest consensus state: current_term: 1 leader_uuid: "2b17abca59094372ac1fa699ff872678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b17abca59094372ac1fa699ff872678" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44655 } } }
I20260809 18:56:16.777547 18925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:16.778380 18924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b17abca59094372ac1fa699ff872678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b17abca59094372ac1fa699ff872678" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44655 } } }
I20260809 18:56:16.778633 18924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:16.781875 18934 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:16.786651 18934 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:16.795305 18934 catalog_manager.cc:1347] Generated new cluster ID: 09497e7336f64eb68cf43a679ad66ce0
I20260809 18:56:16.795384 18934 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:16.830179 18934 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:16.831997 18934 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:16.838349 18934 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678: Generated new TSK 0
I20260809 18:56:16.839066 18934 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:16.892459 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:44655
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:17.208568 18955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:17.208823 18955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:17.208951 18955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:17.215776 18955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:17.215873 18955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:17.215987 18955 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:17.216085 18955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:17.225268 18955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:44655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:17.226459 18955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:17.227793 18955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:17.239866 18961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:17.239900 18962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:17.239945 18964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:17.240990 18955 server_base.cc:1034] running on GCE node
I20260809 18:56:17.241585 18955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:17.242430 18955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:17.243639 18955 hybrid_clock.cc:648] HybridClock initialized: now 1786301777243574 us; error 42 us; skew 500 ppm
I20260809 18:56:17.243911 18955 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:17 dist-test-slave-266d krb5kdc[18790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301777, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:17.246836 18955 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:17.248144 18955 webserver.cc:460] Webserver started at http://127.16.188.193:46883/ using document root <none> and password file <none>
I20260809 18:56:17.248768 18955 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:17.248867 18955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:17.249205 18955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:17.251904 18955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "84926f62bf394cc4acab9cc78f726843"
format_stamp: "Formatted at 2026-08-09 18:56:17 on dist-test-slave-266d"
server_key: "f5fe12402f46f5b8e56d780c308ea1ed"
server_key_iv: "e9c5f1424aa0a6ac8020d30a9f9c11e9"
server_key_version: "encryptionkey@0"
I20260809 18:56:17.252638 18955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "84926f62bf394cc4acab9cc78f726843"
format_stamp: "Formatted at 2026-08-09 18:56:17 on dist-test-slave-266d"
server_key: "f5fe12402f46f5b8e56d780c308ea1ed"
server_key_iv: "e9c5f1424aa0a6ac8020d30a9f9c11e9"
server_key_version: "encryptionkey@0"
I20260809 18:56:17.257406 18955 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260809 18:56:17.260558 18972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:17.261893 18955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:17.262049 18955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "84926f62bf394cc4acab9cc78f726843"
format_stamp: "Formatted at 2026-08-09 18:56:17 on dist-test-slave-266d"
server_key: "f5fe12402f46f5b8e56d780c308ea1ed"
server_key_iv: "e9c5f1424aa0a6ac8020d30a9f9c11e9"
server_key_version: "encryptionkey@0"
I20260809 18:56:17.262228 18955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:17.285653 18955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:17.289309 18955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:17.289518 18955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:17.291985 18955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:17.292089 18955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:17.292217 18955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:17.292295 18955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:56:17 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301777, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:17.313794 18990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:17.293057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:53007 (local address 127.16.188.254:44655)
0809 18:56:17.293510 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:17.293514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:17.294312 (+ 798us) server_negotiation.cc:407] Connection header received
0809 18:56:17.296243 (+ 1931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:17.296249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:17.296349 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:17.296445 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:17.298717 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.299706 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.302311 (+ 2605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.302881 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.302994 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:17.307465 (+ 4471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:17.307470 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:17.307473 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:17.307505 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:17.310093 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:17.311021 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:17.311026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:17.311029 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:17.311207 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:17.311763 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:17.311767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:17.311769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:17.312094 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:17.312242 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:17.313194 (+ 952us) server_negotiation.cc:299] Negotiation successful
0809 18:56:17.313425 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":232,"threads_started":1}
I20260809 18:56:17.314716 18991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:17.293327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:44655 (local address 127.16.188.193:53007)
0809 18:56:17.294158 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:17.294205 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:17.295974 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:17.296740 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:17.296751 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:17.297568 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:17.298472 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:17.298502 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.299878 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.299884 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:17.302175 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:17.302189 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.303159 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.303167 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:17.303462 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:17.304210 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:17.304254 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:17.307254 (+ 3000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:17.310232 (+ 2978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:17.310244 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:17.310258 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:17.310840 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:17.311318 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:17.311321 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:17.311323 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:17.311616 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:17.312303 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:17.312308 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:17.312756 (+ 448us) client_negotiation.cc:769] Sending connection context
0809 18:56:17.313049 (+ 293us) client_negotiation.cc:240] Negotiation successful
0809 18:56:17.313569 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":368,"threads_started":1}
I20260809 18:56:17.334906 19087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:17.320695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:44655 (local address 127.16.188.193:39775)
0809 18:56:17.321345 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:17.321367 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:17.321518 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:17.321802 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:17.321807 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:17.322367 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:17.322750 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:17.322772 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.323709 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.323714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:17.325399 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:17.325417 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.326405 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.326410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:17.326558 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:17.327225 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:17.327241 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:17.328203 (+ 962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:17.331804 (+ 3601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:17.331809 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:17.331813 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:17.332305 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:17.332766 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:17.332771 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:17.332775 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:17.332949 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:17.333643 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:17.333647 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:17.333857 (+ 210us) client_negotiation.cc:769] Sending connection context
0809 18:56:17.334028 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 18:56:17.334338 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":315,"threads_started":1}
I20260809 18:56:17.335381 18990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:17.320671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:39775 (local address 127.16.188.254:44655)
0809 18:56:17.320852 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:17.320857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:17.321463 (+ 606us) server_negotiation.cc:407] Connection header received
0809 18:56:17.321620 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:17.321624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:17.321680 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:17.321753 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:17.322904 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.323607 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.325545 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.326014 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.326144 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:17.328389 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:17.328396 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:17.328402 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:17.328442 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:17.331670 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:17.332474 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:17.332478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:17.332480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:17.332619 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:17.333070 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:17.333075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:17.333079 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:17.333449 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:17.333585 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:17.334945 (+ 1360us) server_negotiation.cc:299] Negotiation successful
0809 18:56:17.335169 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 18:56:17.340706 18955 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:35887
I20260809 18:56:17.340728 19156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:35887 every 8 connection(s)
I20260809 18:56:17.341849 18955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:17.343685 19158 heartbeater.cc:347] Connected to a master server at 127.16.188.254:44655
I20260809 18:56:17.343887 19158 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:17.344478 19158 heartbeater.cc:511] Master 127.16.188.254:44655 requested a full tablet report, sending...
I20260809 18:56:17.346304 18854 ts_manager.cc:194] Registered new tserver with Master: 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887)
I20260809 18:56:17.347694 18854 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:53007
I20260809 18:56:17.349164 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18955
I20260809 18:56:17.349388 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:17.350198 17139 external_mini_cluster.cc:1428] Setting key dfd4386a056cdf92cf4752261aa48bc7
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:17.388931 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:44655
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:17.705395 19164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:17.705751 19164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:17.705919 19164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:17.713583 19164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:17.713682 19164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:17.713770 19164 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:17.713850 19164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:17.724243 19164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:44655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:17.725606 19164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:17.727057 19164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:17.740674 19175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:17.740700 19177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:17.745774 19174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:17.746724 19164 server_base.cc:1034] running on GCE node
I20260809 18:56:17.747315 19164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:17.748268 19164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:17.749483 19164 hybrid_clock.cc:648] HybridClock initialized: now 1786301777749413 us; error 43 us; skew 500 ppm
I20260809 18:56:17.749796 19164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:17 dist-test-slave-266d krb5kdc[18790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301777, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:17.753008 19164 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:17.754664 19164 webserver.cc:460] Webserver started at http://127.16.188.194:45505/ using document root <none> and password file <none>
I20260809 18:56:17.755332 19164 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:17.755432 19164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:17.755753 19164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:17.758775 19164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "f6a940efb3d64ef080228e6481c01a69"
format_stamp: "Formatted at 2026-08-09 18:56:17 on dist-test-slave-266d"
server_key: "abae6858e6974d6d5587344c94c0ecf5"
server_key_iv: "fb594c2529751799fea0e594ab20d056"
server_key_version: "encryptionkey@0"
I20260809 18:56:17.759572 19164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "f6a940efb3d64ef080228e6481c01a69"
format_stamp: "Formatted at 2026-08-09 18:56:17 on dist-test-slave-266d"
server_key: "abae6858e6974d6d5587344c94c0ecf5"
server_key_iv: "fb594c2529751799fea0e594ab20d056"
server_key_version: "encryptionkey@0"
I20260809 18:56:17.765165 19164 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 18:56:17.768796 19190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:17.770128 19164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:17.770294 19164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "f6a940efb3d64ef080228e6481c01a69"
format_stamp: "Formatted at 2026-08-09 18:56:17 on dist-test-slave-266d"
server_key: "abae6858e6974d6d5587344c94c0ecf5"
server_key_iv: "fb594c2529751799fea0e594ab20d056"
server_key_version: "encryptionkey@0"
I20260809 18:56:17.770507 19164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:17.789511 19164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:17.793449 19164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:17.793710 19164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:17.796283 19164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:17.796383 19164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:17.796512 19164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:17.796569 19164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:56:17 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301777, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:17.819180 18990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:17.796924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:41331 (local address 127.16.188.254:44655)
0809 18:56:17.797139 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:17.797146 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:17.798542 (+ 1396us) server_negotiation.cc:407] Connection header received
0809 18:56:17.800522 (+ 1980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:17.800528 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:17.800624 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:17.800707 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:17.802871 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.803885 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.806311 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.806746 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.806869 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:17.811890 (+ 5021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:17.811898 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:17.811904 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:17.811947 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:17.815493 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:17.816325 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:17.816331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:17.816335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:17.816493 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:17.817001 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:17.817007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:17.817010 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:17.817522 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:17.817696 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:17.818535 (+ 839us) server_negotiation.cc:299] Negotiation successful
0809 18:56:17.818779 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 18:56:17.820402 19201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:17.797472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:44655 (local address 127.16.188.194:41331)
0809 18:56:17.798358 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:17.798401 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:17.800246 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:17.801029 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:17.801042 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:17.801850 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:17.802693 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:17.802713 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.804058 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.804064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:17.806168 (+ 2104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:17.806183 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.807016 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.807024 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:17.807409 (+ 385us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:17.808270 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:17.808303 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:17.811612 (+ 3309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:17.815645 (+ 4033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:17.815653 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:17.815668 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:17.816200 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:17.816600 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:17.816605 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:17.816608 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:17.816856 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:17.817665 (+ 809us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:17.817672 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:17.818140 (+ 468us) client_negotiation.cc:769] Sending connection context
0809 18:56:17.818407 (+ 267us) client_negotiation.cc:240] Negotiation successful
0809 18:56:17.818913 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":384,"threads_started":1}
I20260809 18:56:17.841332 18990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:17.827790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:39395 (local address 127.16.188.254:44655)
0809 18:56:17.827952 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:17.827957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:17.828174 (+ 217us) server_negotiation.cc:407] Connection header received
0809 18:56:17.828344 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:17.828348 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:17.828418 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:17.828494 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:17.829815 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.830727 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.832651 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.833279 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.833391 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:17.835452 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:17.835459 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:17.835462 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:17.835492 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:17.838284 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:17.839133 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:17.839139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:17.839142 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:17.839311 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:17.839678 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:17.839682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:17.839685 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:17.840135 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:17.840289 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:17.840749 (+ 460us) server_negotiation.cc:299] Negotiation successful
0809 18:56:17.840975 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:56:17.841509 19295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:17.827344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:44655 (local address 127.16.188.194:39395)
0809 18:56:17.828058 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:17.828079 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:17.828235 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:17.828533 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:17.828538 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:17.829210 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:17.829662 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:17.829681 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.830868 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.830874 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:17.832434 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:17.832453 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:17.833465 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:17.833472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:17.833615 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:17.834181 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:17.834201 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:17.835206 (+ 1005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:17.838413 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:17.838419 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:17.838424 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:17.838981 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:17.839417 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:17.839422 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:17.839426 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:17.839574 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:17.840272 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:17.840278 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:17.840491 (+ 213us) client_negotiation.cc:769] Sending connection context
0809 18:56:17.840647 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 18:56:17.840988 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":488,"threads_started":1}
I20260809 18:56:17.850328 19164 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:37577
I20260809 18:56:17.850347 19358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:37577 every 8 connection(s)
I20260809 18:56:17.851490 19164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:17.853941 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19164
I20260809 18:56:17.853946 19359 heartbeater.cc:347] Connected to a master server at 127.16.188.254:44655
I20260809 18:56:17.854156 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:17.854169 19359 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:17.854590 17139 external_mini_cluster.cc:1428] Setting key 81844272ccbd67477fad1e66beeac6df
I20260809 18:56:17.854882 19359 heartbeater.cc:511] Master 127.16.188.254:44655 requested a full tablet report, sending...
I20260809 18:56:17.856412 18853 ts_manager.cc:194] Registered new tserver with Master: f6a940efb3d64ef080228e6481c01a69 (127.16.188.194:37577)
I20260809 18:56:17.857388 18853 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:41331
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
I20260809 18:56:18.350710 19158 heartbeater.cc:503] Master 127.16.188.254:44655 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
W20260809 18:56:18.676810 17139 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.16.188.195: real 0.820s user 0.000s sys 0.011s
I20260809 18:56:18.677702 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:44655
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:56:18.859756 19359 heartbeater.cc:503] Master 127.16.188.254:44655 was elected leader, sending a full tablet report...
W20260809 18:56:19.011233 19364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:19.011495 19364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:19.011601 19364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:19.019402 19364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:19.019505 19364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:19.019595 19364 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:19.019680 19364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:19.029459 19364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:44655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:19.030615 19364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:19.031945 19364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:19.044581 19376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:19.045131 19372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:19.045163 19373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:19.045593 19364 server_base.cc:1034] running on GCE node
I20260809 18:56:19.046132 19364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:19.046985 19364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:19.048189 19364 hybrid_clock.cc:648] HybridClock initialized: now 1786301779048135 us; error 25 us; skew 500 ppm
I20260809 18:56:19.048444 19364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:19 dist-test-slave-266d krb5kdc[18790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301779, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:19.051507 19364 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:19.052871 19364 webserver.cc:460] Webserver started at http://127.16.188.195:40999/ using document root <none> and password file <none>
I20260809 18:56:19.053542 19364 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:19.053632 19364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:19.053910 19364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:19.056735 19364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3"
format_stamp: "Formatted at 2026-08-09 18:56:19 on dist-test-slave-266d"
server_key: "9544bba8b045723953073213905443b7"
server_key_iv: "db28c349b8002eac79b108c86d663fdf"
server_key_version: "encryptionkey@0"
I20260809 18:56:19.057659 19364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3"
format_stamp: "Formatted at 2026-08-09 18:56:19 on dist-test-slave-266d"
server_key: "9544bba8b045723953073213905443b7"
server_key_iv: "db28c349b8002eac79b108c86d663fdf"
server_key_version: "encryptionkey@0"
I20260809 18:56:19.062630 19364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:56:19.066063 19385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:19.067271 19364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 18:56:19.067425 19364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3"
format_stamp: "Formatted at 2026-08-09 18:56:19 on dist-test-slave-266d"
server_key: "9544bba8b045723953073213905443b7"
server_key_iv: "db28c349b8002eac79b108c86d663fdf"
server_key_version: "encryptionkey@0"
I20260809 18:56:19.067615 19364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:19.082201 19364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:19.086015 19364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:19.086263 19364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:19.088863 19364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:19.088964 19364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:19.089112 19364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:19.089187 19364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 09 18:56:19 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301779, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:19.115921 19396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.089424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:38609 (local address 127.16.188.254:44655)
0809 18:56:19.091895 (+ 2471us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.091902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.091928 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:56:19.093398 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.093404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.093551 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.093690 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:19.095797 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.097007 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.099994 (+ 2987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.100868 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.100987 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.105969 (+ 4982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:19.105975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:19.105980 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:19.106022 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:19.111269 (+ 5247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:19.112593 (+ 1324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:19.112600 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:19.112604 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:19.112878 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:19.113480 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:19.113487 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:19.113490 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:19.113867 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:19.114007 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.115068 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.115327 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2332,"thread_start_us":2195,"threads_started":1}
I20260809 18:56:19.117803 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.090105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:44655 (local address 127.16.188.195:38609)
0809 18:56:19.091060 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:19.091113 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:19.093107 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:19.093931 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:19.093946 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:19.094544 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:19.095621 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.095642 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.097231 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.097235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.099793 (+ 2558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.099810 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.101275 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.101287 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.101536 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.102277 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:19.102302 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:19.105681 (+ 3379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:19.111409 (+ 5728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:19.111416 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:19.111429 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:19.111954 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:19.112983 (+ 1029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:19.112986 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:19.112989 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:19.113357 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:19.114002 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:19.114010 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:19.114505 (+ 495us) client_negotiation.cc:769] Sending connection context
0809 18:56:19.114873 (+ 368us) client_negotiation.cc:240] Negotiation successful
0809 18:56:19.115517 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":384,"threads_started":1}
I20260809 18:56:19.146341 19396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.125931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:43675 (local address 127.16.188.254:44655)
0809 18:56:19.126150 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.126156 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.127513 (+ 1357us) server_negotiation.cc:407] Connection header received
0809 18:56:19.127690 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.127696 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.127776 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.127882 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:19.129534 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.130768 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.133583 (+ 2815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.134438 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.134674 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.137900 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:19.137907 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:19.137913 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:19.137953 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:19.142709 (+ 4756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:19.143955 (+ 1246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:19.143962 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:19.143965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:19.144129 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:19.144596 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:19.144601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:19.144604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:19.144913 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:19.145120 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.145787 (+ 667us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.146020 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 18:56:19.147006 19453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.126106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:44655 (local address 127.16.188.195:43675)
0809 18:56:19.127429 (+ 1323us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:19.127444 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:19.127569 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:19.127893 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:19.127896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:19.128576 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:19.129398 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.129411 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.130914 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.130920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.133420 (+ 2500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.133438 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.134706 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.134715 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.134990 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.135920 (+ 930us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:19.135937 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:19.137623 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:19.142855 (+ 5232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:19.142861 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:19.142869 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:19.143799 (+ 930us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:19.144257 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:19.144262 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:19.144266 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:19.144479 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:19.145027 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:19.145032 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:19.145441 (+ 409us) client_negotiation.cc:769] Sending connection context
0809 18:56:19.145638 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 18:56:19.146082 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1135,"thread_start_us":880,"threads_started":1}
I20260809 18:56:19.186281 19557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:45571 every 8 connection(s)
I20260809 18:56:19.186290 19364 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:45571
I20260809 18:56:19.187784 19364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:19.189836 19558 heartbeater.cc:347] Connected to a master server at 127.16.188.254:44655
I20260809 18:56:19.190032 19558 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:19.190697 19558 heartbeater.cc:511] Master 127.16.188.254:44655 requested a full tablet report, sending...
I20260809 18:56:19.191995 18853 ts_manager.cc:194] Registered new tserver with Master: 24a7ad9cdc4d4c9c80c4d001b91ee0c3 (127.16.188.195:45571)
I20260809 18:56:19.192847 18853 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:38609
I20260809 18:56:19.197201 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19364
I20260809 18:56:19.197347 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:19.197784 17139 external_mini_cluster.cc:1428] Setting key bf6e91829a6f5813792d1839ba7e699d
I20260809 18:56:19.200382 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:19 dist-test-slave-266d krb5kdc[18790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301779, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:56:19 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301779, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:19.299851 19396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.286689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55104 (local address 127.16.188.254:44655)
0809 18:56:19.286926 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.286933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.287123 (+ 190us) server_negotiation.cc:407] Connection header received
0809 18:56:19.287352 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.287356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.287423 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.287511 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:19.288947 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.289753 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.291033 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.291460 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.291571 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.295483 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:19.295488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:19.295491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:19.295523 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:19.297835 (+ 2312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:19.298376 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:19.298379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:19.298381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:19.298503 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:19.298773 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:19.298775 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:19.298777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:19.299024 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:19.299222 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.299431 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.299596 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 18:56:19.303915 18853 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:19.310824 18853 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:19.334107 19582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.323330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41758 (local address 127.16.188.193:35887)
0809 18:56:19.325817 (+ 2487us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.325825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.325853 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:56:19.325951 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.325959 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.326204 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.326414 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:19.327142 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.328643 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.331646 (+ 3003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.332943 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.333131 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.333315 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.333643 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.333803 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2329,"thread_start_us":2211,"threads_started":1}
I20260809 18:56:19.334203 19585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.323335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:45571 (local address 127.0.0.1:34308)
0809 18:56:19.324743 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:19.324759 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:19.324864 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:19.326778 (+ 1914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:19.326783 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:19.326806 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:19.327304 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.327317 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.329464 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.329469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.331692 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.331706 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.333244 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.333250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.333453 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.333488 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:56:19.333562 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 18:56:19.333759 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1284,"mutex_wait_us":6,"thread_start_us":1164,"threads_started":1}
I20260809 18:56:19.334249 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.323133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:35887 (local address 127.0.0.1:41758)
0809 18:56:19.324027 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:19.324075 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:19.324226 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:19.326430 (+ 2204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:19.326437 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:19.326468 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:19.326930 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.326946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.328788 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.328793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.331431 (+ 2638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.331461 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.333137 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.333144 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.333376 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.333470 (+ 94us) client_negotiation.cc:769] Sending connection context
0809 18:56:19.333576 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 18:56:19.333765 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":134,"thread_start_us":490,"threads_started":1}
I20260809 18:56:19.335276 19586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.323862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34308 (local address 127.16.188.195:45571)
0809 18:56:19.326230 (+ 2368us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.326236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.326262 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:56:19.326334 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.326341 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.326555 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.327506 (+ 951us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:19.327823 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.329326 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.331874 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.332980 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.334584 (+ 1604us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.334737 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.334800 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.334956 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2236,"thread_start_us":2040,"threads_started":1}
I20260809 18:56:19.335371 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.326189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55172 (local address 127.16.188.194:37577)
0809 18:56:19.326948 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.326955 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.327563 (+ 608us) server_negotiation.cc:407] Connection header received
0809 18:56:19.327844 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.327851 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.328062 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.328214 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:19.328964 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.330111 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.332631 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.334066 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.334230 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.334390 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.334917 (+ 527us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.335089 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":490,"threads_started":1}
I20260809 18:56:19.336007 19587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.325595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37577 (local address 127.0.0.1:55172)
0809 18:56:19.327443 (+ 1848us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:19.327468 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:19.327656 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:19.328461 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:19.328464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:19.328483 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:19.328775 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.328785 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.330249 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.330257 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.332484 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.332499 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.334531 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.334538 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.334714 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.334743 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 18:56:19.335600 (+ 857us) client_negotiation.cc:240] Negotiation successful
0809 18:56:19.335719 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1737,"mutex_wait_us":57,"thread_start_us":2340,"threads_started":1}
I20260809 18:56:19.338063 19051 tablet_service.cc:1467] Processing CreateTablet for tablet 6185808a4b7843ab822fbacd03239374 (DEFAULT_TABLE table=test-table [id=ae2daca9c1aa4680a23b0fc745baeb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:19.338753 19253 tablet_service.cc:1467] Processing CreateTablet for tablet 6185808a4b7843ab822fbacd03239374 (DEFAULT_TABLE table=test-table [id=ae2daca9c1aa4680a23b0fc745baeb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:19.339327 19051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6185808a4b7843ab822fbacd03239374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:19.339856 19253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6185808a4b7843ab822fbacd03239374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:19.348030 19470 tablet_service.cc:1467] Processing CreateTablet for tablet 6185808a4b7843ab822fbacd03239374 (DEFAULT_TABLE table=test-table [id=ae2daca9c1aa4680a23b0fc745baeb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:19.349495 19470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6185808a4b7843ab822fbacd03239374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:19.352339 19590 tablet_bootstrap.cc:492] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Bootstrap starting.
I20260809 18:56:19.355159 19591 tablet_bootstrap.cc:492] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Bootstrap starting.
I20260809 18:56:19.358168 19591 tablet_bootstrap.cc:654] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:19.358507 19590 tablet_bootstrap.cc:654] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:19.359205 19591 log.cc:824] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:19.359844 19590 log.cc:824] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:19.362032 19591 tablet_bootstrap.cc:492] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: No bootstrap required, opened a new log
I20260809 18:56:19.362284 19591 ts_tablet_manager.cc:1397] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 18:56:19.363224 19590 tablet_bootstrap.cc:492] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: No bootstrap required, opened a new log
I20260809 18:56:19.363613 19590 ts_tablet_manager.cc:1397] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260809 18:56:19.369995 19591 raft_consensus.cc:348] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.370342 19591 raft_consensus.cc:374] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:19.370437 19591 raft_consensus.cc:729] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6a940efb3d64ef080228e6481c01a69, State: Initialized, Role: FOLLOWER
I20260809 18:56:19.370636 19595 tablet_bootstrap.cc:492] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Bootstrap starting.
I20260809 18:56:19.371138 19591 consensus_queue.cc:260] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.373479 19591 ts_tablet_manager.cc:1428] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260809 18:56:19.376127 19595 tablet_bootstrap.cc:654] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:19.377753 19595 log.cc:824] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:19.377745 19590 raft_consensus.cc:348] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.378347 19590 raft_consensus.cc:374] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:19.378522 19590 raft_consensus.cc:729] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84926f62bf394cc4acab9cc78f726843, State: Initialized, Role: FOLLOWER
I20260809 18:56:19.379258 19590 consensus_queue.cc:260] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.382700 19590 ts_tablet_manager.cc:1428] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Time spent starting tablet: real 0.019s user 0.016s sys 0.000s
I20260809 18:56:19.383360 19595 tablet_bootstrap.cc:492] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: No bootstrap required, opened a new log
I20260809 18:56:19.383718 19595 ts_tablet_manager.cc:1397] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260809 18:56:19.394524 19595 raft_consensus.cc:348] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.395021 19595 raft_consensus.cc:374] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:19.395160 19595 raft_consensus.cc:729] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, State: Initialized, Role: FOLLOWER
I20260809 18:56:19.395784 19595 consensus_queue.cc:260] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.397225 19558 heartbeater.cc:503] Master 127.16.188.254:44655 was elected leader, sending a full tablet report...
I20260809 18:56:19.397734 19595 ts_tablet_manager.cc:1428] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Time spent starting tablet: real 0.014s user 0.005s sys 0.010s
W20260809 18:56:19.439698 19559 tablet.cc:2369] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:19.513362 19599 raft_consensus.cc:482] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:19.513789 19599 raft_consensus.cc:504] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.515861 19599 leader_election.cc:288] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887), f6a940efb3d64ef080228e6481c01a69 (127.16.188.194:37577)
I20260809 18:56:19.523922 19582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.516223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:60153 (local address 127.16.188.193:35887)
0809 18:56:19.516521 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.516527 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.516909 (+ 382us) server_negotiation.cc:407] Connection header received
0809 18:56:19.517159 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.517166 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.517233 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.517318 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:19.517977 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.519241 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.521600 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.523071 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.523263 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.523340 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.523593 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.523685 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 18:56:19.524010 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.516579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:35887 (local address 127.16.188.195:60153)
0809 18:56:19.516801 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:19.516822 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:19.516998 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:19.517380 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:19.517385 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:19.517415 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:19.517800 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.517816 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.519406 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.519412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.521446 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.521459 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.523227 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.523233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.523440 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.523475 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:56:19.523572 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 18:56:19.523701 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":29}
I20260809 18:56:19.525350 19075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6185808a4b7843ab822fbacd03239374" candidate_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84926f62bf394cc4acab9cc78f726843" is_pre_election: true
I20260809 18:56:19.525974 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.516253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:56605 (local address 127.16.188.194:37577)
0809 18:56:19.516507 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.516513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.518317 (+ 1804us) server_negotiation.cc:407] Connection header received
0809 18:56:19.518468 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.518472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.518531 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.518619 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:19.519480 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.520713 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.523433 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.524926 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.525064 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.525153 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.525683 (+ 530us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.525772 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 18:56:19.526345 19600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.517156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37577 (local address 127.16.188.195:56605)
0809 18:56:19.518200 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:19.518219 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:19.518361 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:19.518636 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:19.518640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:19.518665 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:19.519226 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.519237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.520868 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.520872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.523284 (+ 2412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:19.523298 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.525222 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.525231 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:19.525513 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.525549 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 18:56:19.525647 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 18:56:19.525771 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"mutex_wait_us":8,"thread_start_us":592,"threads_started":1}
I20260809 18:56:19.526237 19075 raft_consensus.cc:2454] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7ad9cdc4d4c9c80c4d001b91ee0c3 in term 0.
I20260809 18:56:19.527091 19386 leader_election.cc:302] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, 84926f62bf394cc4acab9cc78f726843; no voters:
I20260809 18:56:19.527554 19599 raft_consensus.cc:2781] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:19.527391 19287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6185808a4b7843ab822fbacd03239374" candidate_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6a940efb3d64ef080228e6481c01a69" is_pre_election: true
I20260809 18:56:19.527707 19599 raft_consensus.cc:482] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:19.527863 19599 raft_consensus.cc:3037] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:19.528002 19287 raft_consensus.cc:2454] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7ad9cdc4d4c9c80c4d001b91ee0c3 in term 0.
I20260809 18:56:19.530740 19599 raft_consensus.cc:504] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.531399 19599 leader_election.cc:288] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [CANDIDATE]: Term 1 election: Requested vote from peers 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887), f6a940efb3d64ef080228e6481c01a69 (127.16.188.194:37577)
I20260809 18:56:19.531831 19075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6185808a4b7843ab822fbacd03239374" candidate_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84926f62bf394cc4acab9cc78f726843"
I20260809 18:56:19.531855 19287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6185808a4b7843ab822fbacd03239374" candidate_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6a940efb3d64ef080228e6481c01a69"
I20260809 18:56:19.532037 19287 raft_consensus.cc:3037] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:19.532050 19075 raft_consensus.cc:3037] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:19.535085 19287 raft_consensus.cc:2454] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7ad9cdc4d4c9c80c4d001b91ee0c3 in term 1.
I20260809 18:56:19.535123 19075 raft_consensus.cc:2454] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7ad9cdc4d4c9c80c4d001b91ee0c3 in term 1.
I20260809 18:56:19.535538 19387 leader_election.cc:302] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, f6a940efb3d64ef080228e6481c01a69; no voters:
I20260809 18:56:19.535920 19599 raft_consensus.cc:2781] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:19.536526 19599 raft_consensus.cc:686] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 LEADER]: Becoming Leader. State: Replica: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, State: Running, Role: LEADER
I20260809 18:56:19.537040 19599 consensus_queue.cc:237] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } }
I20260809 18:56:19.541924 18853 catalog_manager.cc:5495] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24a7ad9cdc4d4c9c80c4d001b91ee0c3 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:19.584308 19586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:19.578532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34312 (local address 127.16.188.195:45571)
0809 18:56:19.578721 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:19.578727 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:19.578803 (+ 76us) server_negotiation.cc:407] Connection header received
0809 18:56:19.579155 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:19.579159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:19.579248 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:19.579376 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:19.579745 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.580425 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.581886 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:19.582419 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:19.582532 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:19.583075 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:19.583668 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:19.583803 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:19.583929 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 18:56:19.584010 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 18:56:19.595067 19159 tablet.cc:2369] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:19.599855 19287 raft_consensus.cc:1261] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Refusing update from remote peer 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:19.601084 19601 consensus_queue.cc:1035] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:19.602056 19075 raft_consensus.cc:1261] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Refusing update from remote peer 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:19.602779 19601 consensus_queue.cc:1035] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 18:56:19.603983 19361 tablet.cc:2369] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:19.635116 18854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:19.635416 18854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:19.639382 18854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678: Sending DeleteTablet for 3 replicas of tablet 6185808a4b7843ab822fbacd03239374
I20260809 18:56:19.640728 19051 tablet_service.cc:1514] Processing DeleteTablet for tablet 6185808a4b7843ab822fbacd03239374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:19 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:41758
I20260809 18:56:19.641206 19253 tablet_service.cc:1514] Processing DeleteTablet for tablet 6185808a4b7843ab822fbacd03239374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:19 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:55172
I20260809 18:56:19.641623 19470 tablet_service.cc:1514] Processing DeleteTablet for tablet 6185808a4b7843ab822fbacd03239374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:19 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:34308
I20260809 18:56:19.642537 18853 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:19.643306 18853 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:19.651863 19252 tablet_service.cc:1467] Processing CreateTablet for tablet ba657a75d04744fa953af3e28b38ce23 (DEFAULT_TABLE table=test-table [id=4c8dfad378594e7c8e4f3fae11345b78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:19.652525 19252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba657a75d04744fa953af3e28b38ce23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:19.653617 19622 tablet_replica.cc:330] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: stopping tablet replica
I20260809 18:56:19.654214 19622 raft_consensus.cc:2229] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:19.656584 19622 raft_consensus.cc:2258] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:19.657953 19469 tablet_service.cc:1467] Processing CreateTablet for tablet ba657a75d04744fa953af3e28b38ce23 (DEFAULT_TABLE table=test-table [id=4c8dfad378594e7c8e4f3fae11345b78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:19.658445 19469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba657a75d04744fa953af3e28b38ce23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:19.658802 19051 tablet_service.cc:1467] Processing CreateTablet for tablet ba657a75d04744fa953af3e28b38ce23 (DEFAULT_TABLE table=test-table [id=4c8dfad378594e7c8e4f3fae11345b78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:19.659324 19051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba657a75d04744fa953af3e28b38ce23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:19.660400 19591 tablet_bootstrap.cc:492] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: Bootstrap starting.
I20260809 18:56:19.662232 19591 tablet_bootstrap.cc:654] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:19.662843 19623 tablet_replica.cc:330] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: stopping tablet replica
I20260809 18:56:19.664491 19623 raft_consensus.cc:2229] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:19.664587 19622 ts_tablet_manager.cc:1905] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:19.665166 19623 raft_consensus.cc:2258] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:19.665818 19624 tablet_replica.cc:330] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: stopping tablet replica
I20260809 18:56:19.667294 19624 raft_consensus.cc:2229] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:19.667907 19623 ts_tablet_manager.cc:1905] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:19.668052 19624 raft_consensus.cc:2258] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:19.668396 19595 tablet_bootstrap.cc:492] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Bootstrap starting.
I20260809 18:56:19.670909 19595 tablet_bootstrap.cc:654] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:19.671999 19590 tablet_bootstrap.cc:492] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: Bootstrap starting.
I20260809 18:56:19.673348 19624 ts_tablet_manager.cc:1905] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:19.673796 19590 tablet_bootstrap.cc:654] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:19.679768 19591 tablet_bootstrap.cc:492] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: No bootstrap required, opened a new log
I20260809 18:56:19.679955 19591 ts_tablet_manager.cc:1397] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.008s
I20260809 18:56:19.680900 19591 raft_consensus.cc:348] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:19.681258 19591 raft_consensus.cc:374] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:19.681419 19591 raft_consensus.cc:729] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6a940efb3d64ef080228e6481c01a69, State: Initialized, Role: FOLLOWER
I20260809 18:56:19.683043 19591 consensus_queue.cc:260] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:19.684700 19591 ts_tablet_manager.cc:1428] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260809 18:56:19.685030 19623 ts_tablet_manager.cc:1918] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:19.685370 19623 log.cc:1196] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/6185808a4b7843ab822fbacd03239374
I20260809 18:56:19.686201 19623 ts_tablet_manager.cc:1939] T 6185808a4b7843ab822fbacd03239374 P f6a940efb3d64ef080228e6481c01a69: Deleting consensus metadata
I20260809 18:56:19.688266 19590 tablet_bootstrap.cc:492] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: No bootstrap required, opened a new log
I20260809 18:56:19.688437 19590 ts_tablet_manager.cc:1397] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.000s
I20260809 18:56:19.688407 18833 catalog_manager.cc:4841] TS f6a940efb3d64ef080228e6481c01a69 (127.16.188.194:37577): tablet 6185808a4b7843ab822fbacd03239374 (table test-table [id=ae2daca9c1aa4680a23b0fc745baeb7e]) successfully deleted
I20260809 18:56:19.688864 19622 ts_tablet_manager.cc:1918] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:19.689142 19622 log.cc:1196] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/6185808a4b7843ab822fbacd03239374
I20260809 18:56:19.689419 19590 raft_consensus.cc:348] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:19.689749 19590 raft_consensus.cc:374] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:19.689833 19622 ts_tablet_manager.cc:1939] T 6185808a4b7843ab822fbacd03239374 P 84926f62bf394cc4acab9cc78f726843: Deleting consensus metadata
I20260809 18:56:19.689914 19590 raft_consensus.cc:729] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84926f62bf394cc4acab9cc78f726843, State: Initialized, Role: FOLLOWER
I20260809 18:56:19.690227 19595 tablet_bootstrap.cc:492] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: No bootstrap required, opened a new log
I20260809 18:56:19.690402 19595 ts_tablet_manager.cc:1397] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260809 18:56:19.690316 19590 consensus_queue.cc:260] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:19.691087 19590 ts_tablet_manager.cc:1428] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:19.691339 19595 raft_consensus.cc:348] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:19.691596 19595 raft_consensus.cc:374] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:19.691713 19595 raft_consensus.cc:729] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, State: Initialized, Role: FOLLOWER
I20260809 18:56:19.692011 19595 consensus_queue.cc:260] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:19.692682 19595 ts_tablet_manager.cc:1428] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 18:56:19.693981 19624 ts_tablet_manager.cc:1918] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:19.694224 19624 log.cc:1196] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/6185808a4b7843ab822fbacd03239374
I20260809 18:56:19.694890 19624 ts_tablet_manager.cc:1939] T 6185808a4b7843ab822fbacd03239374 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Deleting consensus metadata
I20260809 18:56:19.696830 18832 catalog_manager.cc:4841] TS 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887): tablet 6185808a4b7843ab822fbacd03239374 (table test-table [id=ae2daca9c1aa4680a23b0fc745baeb7e]) successfully deleted
I20260809 18:56:19.696839 18836 catalog_manager.cc:4841] TS 24a7ad9cdc4d4c9c80c4d001b91ee0c3 (127.16.188.195:45571): tablet 6185808a4b7843ab822fbacd03239374 (table test-table [id=ae2daca9c1aa4680a23b0fc745baeb7e]) successfully deleted
I20260809 18:56:20.001924 19601 raft_consensus.cc:482] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:20.002243 19601 raft_consensus.cc:504] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.003540 19601 leader_election.cc:288] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887), f6a940efb3d64ef080228e6481c01a69 (127.16.188.194:37577)
I20260809 18:56:20.003996 19075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba657a75d04744fa953af3e28b38ce23" candidate_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84926f62bf394cc4acab9cc78f726843" is_pre_election: true
I20260809 18:56:20.004112 19287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba657a75d04744fa953af3e28b38ce23" candidate_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6a940efb3d64ef080228e6481c01a69" is_pre_election: true
I20260809 18:56:20.004302 19075 raft_consensus.cc:2454] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7ad9cdc4d4c9c80c4d001b91ee0c3 in term 0.
I20260809 18:56:20.004444 19287 raft_consensus.cc:2454] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7ad9cdc4d4c9c80c4d001b91ee0c3 in term 0.
I20260809 18:56:20.004906 19386 leader_election.cc:302] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, 84926f62bf394cc4acab9cc78f726843; no voters:
I20260809 18:56:20.005265 19601 raft_consensus.cc:2781] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:20.005527 19601 raft_consensus.cc:482] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:20.005782 19601 raft_consensus.cc:3037] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:20.010586 19601 raft_consensus.cc:504] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.011538 19601 leader_election.cc:288] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [CANDIDATE]: Term 1 election: Requested vote from peers 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887), f6a940efb3d64ef080228e6481c01a69 (127.16.188.194:37577)
I20260809 18:56:20.012037 19287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba657a75d04744fa953af3e28b38ce23" candidate_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6a940efb3d64ef080228e6481c01a69"
I20260809 18:56:20.012223 19287 raft_consensus.cc:3037] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:20.012290 19075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba657a75d04744fa953af3e28b38ce23" candidate_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84926f62bf394cc4acab9cc78f726843"
I20260809 18:56:20.012599 19075 raft_consensus.cc:3037] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:20.014629 19287 raft_consensus.cc:2454] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7ad9cdc4d4c9c80c4d001b91ee0c3 in term 1.
I20260809 18:56:20.015062 19387 leader_election.cc:302] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, f6a940efb3d64ef080228e6481c01a69; no voters:
I20260809 18:56:20.015455 19601 raft_consensus.cc:2781] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:20.015679 19601 raft_consensus.cc:686] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 LEADER]: Becoming Leader. State: Replica: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, State: Running, Role: LEADER
I20260809 18:56:20.016357 19075 raft_consensus.cc:2454] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7ad9cdc4d4c9c80c4d001b91ee0c3 in term 1.
I20260809 18:56:20.016225 19601 consensus_queue.cc:237] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.020207 18854 catalog_manager.cc:5495] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24a7ad9cdc4d4c9c80c4d001b91ee0c3 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } health_report { overall_health: HEALTHY } } }
Aug 09 18:56:20 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301776, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:20.073665 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.052111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:44655 (local address 127.0.0.1:46766)
0809 18:56:20.053862 (+ 1751us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:20.053882 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:20.054063 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:20.054369 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:20.054373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:20.055423 (+ 1050us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:20.055827 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.055839 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.057395 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.057399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.058751 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.058766 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.059884 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.059892 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.060079 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.060888 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:20.060906 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:20.064388 (+ 3482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:20.070287 (+ 5899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:20.070299 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:20.070305 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:20.071048 (+ 743us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:20.071475 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:20.071480 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:20.071483 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:20.071692 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:20.072260 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:20.072294 (+ 34us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:20.072552 (+ 258us) client_negotiation.cc:769] Sending connection context
0809 18:56:20.072750 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 18:56:20.073033 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1519,"thread_start_us":1303,"threads_started":1}
I20260809 18:56:20.073890 19635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.051808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46766 (local address 127.16.188.254:44655)
0809 18:56:20.053016 (+ 1208us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.053020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.053963 (+ 943us) server_negotiation.cc:407] Connection header received
0809 18:56:20.054184 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.054189 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.054246 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.054340 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:20.055965 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.057241 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.058906 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.059653 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.059767 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.064645 (+ 4878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:20.064653 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:20.064658 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:20.064701 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:20.070132 (+ 5431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.071160 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.071165 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.071168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.071368 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.071798 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.071803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.071807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.072132 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:20.072327 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.072910 (+ 583us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.073195 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":1064,"thread_start_us":885,"threads_started":1}
I20260809 18:56:20.081178 18854 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:46766:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:56:20.083011 18854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:20.091226 19469 tablet_service.cc:1467] Processing CreateTablet for tablet b2e33a5a87e34b68af6376707c1638ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3c97ccae814a4fd6b8e3debf49cbafeb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:20.091296 19051 tablet_service.cc:1467] Processing CreateTablet for tablet b2e33a5a87e34b68af6376707c1638ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3c97ccae814a4fd6b8e3debf49cbafeb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:20.091296 19253 tablet_service.cc:1467] Processing CreateTablet for tablet b2e33a5a87e34b68af6376707c1638ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3c97ccae814a4fd6b8e3debf49cbafeb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:20.091786 19469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e33a5a87e34b68af6376707c1638ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:20.092012 19051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e33a5a87e34b68af6376707c1638ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:20.092046 19253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e33a5a87e34b68af6376707c1638ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:20.100251 19595 tablet_bootstrap.cc:492] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Bootstrap starting.
I20260809 18:56:20.101851 19590 tablet_bootstrap.cc:492] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: Bootstrap starting.
I20260809 18:56:20.101886 19591 tablet_bootstrap.cc:492] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: Bootstrap starting.
I20260809 18:56:20.103626 19595 tablet_bootstrap.cc:654] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:20.104876 19590 tablet_bootstrap.cc:654] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:20.104933 19591 tablet_bootstrap.cc:654] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:20.116284 19591 tablet_bootstrap.cc:492] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: No bootstrap required, opened a new log
I20260809 18:56:20.116508 19591 ts_tablet_manager.cc:1397] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260809 18:56:20.117120 19595 tablet_bootstrap.cc:492] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: No bootstrap required, opened a new log
I20260809 18:56:20.117278 19590 tablet_bootstrap.cc:492] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: No bootstrap required, opened a new log
I20260809 18:56:20.117417 19595 ts_tablet_manager.cc:1397] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20260809 18:56:20.117660 19590 ts_tablet_manager.cc:1397] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20260809 18:56:20.117713 19591 raft_consensus.cc:348] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.118304 19591 raft_consensus.cc:374] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:20.118477 19591 raft_consensus.cc:729] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6a940efb3d64ef080228e6481c01a69, State: Initialized, Role: FOLLOWER
I20260809 18:56:20.118803 19595 raft_consensus.cc:348] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.118880 19591 consensus_queue.cc:260] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.119118 19595 raft_consensus.cc:374] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:20.119256 19595 raft_consensus.cc:729] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7ad9cdc4d4c9c80c4d001b91ee0c3, State: Initialized, Role: FOLLOWER
I20260809 18:56:20.119629 19595 consensus_queue.cc:260] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.119556 19596 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.120069 19596 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:20.120179 19601 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.120376 19590 raft_consensus.cc:348] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.120618 19601 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:20.120765 19590 raft_consensus.cc:374] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:20.120954 19590 raft_consensus.cc:729] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84926f62bf394cc4acab9cc78f726843, State: Initialized, Role: FOLLOWER
I20260809 18:56:20.121223 19595 ts_tablet_manager.cc:1428] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:56:20.121413 19590 consensus_queue.cc:260] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.122148 19598 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.122592 19598 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:20.123193 19591 ts_tablet_manager.cc:1428] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260809 18:56:20.124064 19590 ts_tablet_manager.cc:1428] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260809 18:56:20.350731 19596 raft_consensus.cc:482] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:20.350978 19596 raft_consensus.cc:504] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.352794 19596 leader_election.cc:288] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887), 24a7ad9cdc4d4c9c80c4d001b91ee0c3 (127.16.188.195:45571)
I20260809 18:56:20.376641 19643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.353311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:53077 (local address 127.16.188.193:35887)
0809 18:56:20.361898 (+ 8587us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.361906 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.367416 (+ 5510us) server_negotiation.cc:407] Connection header received
0809 18:56:20.367755 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.367761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.367848 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.367934 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:20.368996 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.370595 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.373812 (+ 3217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.375413 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.375649 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.375733 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.375993 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.376175 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8391,"thread_start_us":8195,"threads_started":1}
I20260809 18:56:20.376768 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.352928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:35887 (local address 127.16.188.194:53077)
0809 18:56:20.367276 (+ 14348us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:20.367300 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:20.367555 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:20.368244 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:20.368247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:20.368276 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:20.368730 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.368745 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.370804 (+ 2059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.370808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.373624 (+ 2816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.373642 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.375633 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.375639 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.375811 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.375853 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 18:56:20.375949 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 18:56:20.376098 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14164,"mutex_wait_us":24,"thread_start_us":13889,"threads_started":1}
I20260809 18:56:20.377743 19075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e33a5a87e34b68af6376707c1638ac" candidate_uuid: "f6a940efb3d64ef080228e6481c01a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84926f62bf394cc4acab9cc78f726843" is_pre_election: true
I20260809 18:56:20.378154 19075 raft_consensus.cc:2454] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6a940efb3d64ef080228e6481c01a69 in term 0.
I20260809 18:56:20.378288 19644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.353355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:37703 (local address 127.16.188.195:45571)
0809 18:56:20.368147 (+ 14792us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.368152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.368670 (+ 518us) server_negotiation.cc:407] Connection header received
0809 18:56:20.368825 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.368830 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.368913 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.369004 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:20.370330 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.371659 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.374665 (+ 3006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.376702 (+ 2037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.377356 (+ 654us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.377434 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.377897 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.378030 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14613,"thread_start_us":14351,"threads_started":1}
I20260809 18:56:20.378839 19642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.353019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:45571 (local address 127.16.188.194:37703)
0809 18:56:20.368529 (+ 15510us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:20.368547 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:20.368691 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:20.369048 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:20.369053 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:20.369118 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:20.370120 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.370138 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.371812 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.371818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.374478 (+ 2660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.374492 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.377432 (+ 2940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.377441 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.377713 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.377755 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 18:56:20.377853 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 18:56:20.377985 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15368,"mutex_wait_us":23,"thread_start_us":15735,"threads_started":1}
I20260809 18:56:20.378829 19191 leader_election.cc:302] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84926f62bf394cc4acab9cc78f726843, f6a940efb3d64ef080228e6481c01a69; no voters:
I20260809 18:56:20.379413 19596 raft_consensus.cc:2781] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:20.379678 19596 raft_consensus.cc:482] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:20.379829 19596 raft_consensus.cc:3037] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:20.380115 19499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e33a5a87e34b68af6376707c1638ac" candidate_uuid: "f6a940efb3d64ef080228e6481c01a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" is_pre_election: true
I20260809 18:56:20.380926 19499 raft_consensus.cc:2454] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6a940efb3d64ef080228e6481c01a69 in term 0.
I20260809 18:56:20.383492 19596 raft_consensus.cc:504] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.384248 19596 leader_election.cc:288] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [CANDIDATE]: Term 1 election: Requested vote from peers 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887), 24a7ad9cdc4d4c9c80c4d001b91ee0c3 (127.16.188.195:45571)
I20260809 18:56:20.384766 19499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e33a5a87e34b68af6376707c1638ac" candidate_uuid: "f6a940efb3d64ef080228e6481c01a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3"
I20260809 18:56:20.384738 19075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e33a5a87e34b68af6376707c1638ac" candidate_uuid: "f6a940efb3d64ef080228e6481c01a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84926f62bf394cc4acab9cc78f726843"
I20260809 18:56:20.385018 19499 raft_consensus.cc:3037] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:20.385046 19075 raft_consensus.cc:3037] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:20.387818 19075 raft_consensus.cc:2454] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6a940efb3d64ef080228e6481c01a69 in term 1.
I20260809 18:56:20.388228 19191 leader_election.cc:302] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84926f62bf394cc4acab9cc78f726843, f6a940efb3d64ef080228e6481c01a69; no voters:
I20260809 18:56:20.388554 19499 raft_consensus.cc:2454] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6a940efb3d64ef080228e6481c01a69 in term 1.
I20260809 18:56:20.388688 19596 raft_consensus.cc:2781] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:20.389510 19596 raft_consensus.cc:686] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [term 1 LEADER]: Becoming Leader. State: Replica: f6a940efb3d64ef080228e6481c01a69, State: Running, Role: LEADER
I20260809 18:56:20.390105 19596 consensus_queue.cc:237] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } }
I20260809 18:56:20.392762 19646 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: TxnStatusTablet state changed. Reason: New leader f6a940efb3d64ef080228e6481c01a69. Latest consensus state: current_term: 1 leader_uuid: "f6a940efb3d64ef080228e6481c01a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.393637 19646 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:20.394477 18854 catalog_manager.cc:5495] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6a940efb3d64ef080228e6481c01a69 (127.16.188.194). New cstate: current_term: 1 leader_uuid: "f6a940efb3d64ef080228e6481c01a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:20.395118 19648 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:56:20.396517 19648 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:56:20.436260 19601 consensus_queue.cc:1035] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:20.442816 19601 consensus_queue.cc:1035] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:20.482393 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.472285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37577 (local address 127.0.0.1:40858)
0809 18:56:20.472936 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:20.472955 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:20.473060 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:20.474018 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:20.474024 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:20.474038 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:20.474286 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.474300 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.476686 (+ 2386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.476690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.478390 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.478405 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.479840 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.479845 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.480096 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.480153 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:20.481708 (+ 1555us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:20.481730 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 18:56:20.481804 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 18:56:20.481961 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326}
I20260809 18:56:20.482715 19661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.471757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40858 (local address 127.16.188.194:37577)
0809 18:56:20.473410 (+ 1653us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.473418 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.473464 (+ 46us) server_negotiation.cc:407] Connection header received
0809 18:56:20.473582 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.473588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.473736 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.473971 (+ 235us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:20.474643 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.476506 (+ 1863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.478540 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.479675 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.479826 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.480536 (+ 710us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:20.481549 (+ 1013us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:20.481744 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.481833 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.481929 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1362,"thread_start_us":1040,"threads_started":1}
I20260809 18:56:20.488878 19075 raft_consensus.cc:1261] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Refusing update from remote peer f6a940efb3d64ef080228e6481c01a69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:20.489073 19499 raft_consensus.cc:1261] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 FOLLOWER]: Refusing update from remote peer f6a940efb3d64ef080228e6481c01a69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:20.489975 19646 consensus_queue.cc:1035] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:20.490514 19596 consensus_queue.cc:1035] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:20.502075 19601 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: TxnStatusTablet state changed. Reason: New leader f6a940efb3d64ef080228e6481c01a69. Latest consensus state: current_term: 1 leader_uuid: "f6a940efb3d64ef080228e6481c01a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.502722 19601 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:20.504091 19598 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: TxnStatusTablet state changed. Reason: New leader f6a940efb3d64ef080228e6481c01a69. Latest consensus state: current_term: 1 leader_uuid: "f6a940efb3d64ef080228e6481c01a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.504621 19598 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:20.504902 19653 mvcc.cc:205] Tried to move back new op lower bound from 7316692092873076736 to 7316692092482138112. Current Snapshot: MvccSnapshot[applied={T|T < 7316692092873076736}]
I20260809 18:56:20.506773 19596 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f6a940efb3d64ef080228e6481c01a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.507166 19596 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:20.508864 19652 mvcc.cc:205] Tried to move back new op lower bound from 7316692092873076736 to 7316692092482138112. Current Snapshot: MvccSnapshot[applied={T|T < 7316692092873076736}]
I20260809 18:56:20.508931 19646 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f6a940efb3d64ef080228e6481c01a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.510031 19646 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P f6a940efb3d64ef080228e6481c01a69: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:20.512815 19598 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f6a940efb3d64ef080228e6481c01a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.513222 19598 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P 84926f62bf394cc4acab9cc78f726843: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:20.524860 19601 tablet_replica.cc:439] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f6a940efb3d64ef080228e6481c01a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84926f62bf394cc4acab9cc78f726843" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35887 } } peers { permanent_uuid: "f6a940efb3d64ef080228e6481c01a69" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37577 } } peers { permanent_uuid: "24a7ad9cdc4d4c9c80c4d001b91ee0c3" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45571 } } }
I20260809 18:56:20.526141 19601 tablet_replica.cc:442] T b2e33a5a87e34b68af6376707c1638ac P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:20.547046 19661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.535583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:48579 (local address 127.16.188.194:37577)
0809 18:56:20.535809 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.535816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.537744 (+ 1928us) server_negotiation.cc:407] Connection header received
0809 18:56:20.538014 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.538021 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.538152 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.538249 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:20.539553 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.541178 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.544057 (+ 2879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.545189 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.545338 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.546165 (+ 827us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:20.546308 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:20.546399 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.546576 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.546665 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:56:20.547451 19669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.536080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37577 (local address 127.16.188.195:48579)
0809 18:56:20.537607 (+ 1527us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:20.537633 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:20.537841 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:20.538539 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:20.538543 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:20.538559 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:20.539298 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.539316 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.541438 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.541444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.543897 (+ 2453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.543913 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.545467 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.545476 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.545824 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.545931 (+ 107us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:20.546422 (+ 491us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:20.546435 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:56:20.546546 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 18:56:20.546694 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1199,"thread_start_us":840,"threads_started":1}
I20260809 18:56:20.610375 19644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.593945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:38443 (local address 127.16.188.195:45571)
0809 18:56:20.594924 (+ 979us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.594931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.598589 (+ 3658us) server_negotiation.cc:407] Connection header received
0809 18:56:20.598974 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.599017 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.599155 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.599277 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:20.601250 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.603131 (+ 1881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.607290 (+ 4159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.608212 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.608312 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.609310 (+ 998us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:20.609489 (+ 179us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:20.609568 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.609824 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.609914 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":796}
I20260809 18:56:20.611400 19674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.593296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:45571 (local address 127.16.188.194:38443)
0809 18:56:20.598481 (+ 5185us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:20.598502 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:20.598685 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:20.599666 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:20.599671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:20.599684 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:20.600889 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.600906 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.603386 (+ 2480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.603393 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.607064 (+ 3671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:20.607135 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.608602 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.608611 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:20.608902 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.608977 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:20.609636 (+ 659us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:20.609683 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 18:56:20.610568 (+ 885us) client_negotiation.cc:240] Negotiation successful
0809 18:56:20.610721 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4932,"thread_start_us":3809,"threads_started":1}
I20260809 18:56:20.666301 18854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:20.666581 18854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:20.669726 18854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b17abca59094372ac1fa699ff872678: Sending DeleteTablet for 3 replicas of tablet ba657a75d04744fa953af3e28b38ce23
I20260809 18:56:20.670480 19253 tablet_service.cc:1514] Processing DeleteTablet for tablet ba657a75d04744fa953af3e28b38ce23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:20 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:55172
I20260809 18:56:20.670581 19051 tablet_service.cc:1514] Processing DeleteTablet for tablet ba657a75d04744fa953af3e28b38ce23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:20 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:41758
I20260809 18:56:20.670846 19469 tablet_service.cc:1514] Processing DeleteTablet for tablet ba657a75d04744fa953af3e28b38ce23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:20 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:34308
I20260809 18:56:20.682237 19682 tablet_replica.cc:330] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: stopping tablet replica
I20260809 18:56:20.683038 19682 raft_consensus.cc:2229] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:20.683116 19678 tablet_replica.cc:330] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: stopping tablet replica
I20260809 18:56:20.683143 19681 tablet_replica.cc:330] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: stopping tablet replica
I20260809 18:56:20.683385 19678 raft_consensus.cc:2229] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:20.683370 19681 raft_consensus.cc:2229] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:20.683521 19682 raft_consensus.cc:2258] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:20.683893 19678 raft_consensus.cc:2258] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:20.684458 19681 raft_consensus.cc:2258] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:20.685663 19678 ts_tablet_manager.cc:1905] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:20.686038 19681 ts_tablet_manager.cc:1905] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:20.687740 19682 ts_tablet_manager.cc:1905] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:20.692656 19678 ts_tablet_manager.cc:1918] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:20.692885 19678 log.cc:1196] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/ba657a75d04744fa953af3e28b38ce23
I20260809 18:56:20.693675 19678 ts_tablet_manager.cc:1939] T ba657a75d04744fa953af3e28b38ce23 P 84926f62bf394cc4acab9cc78f726843: Deleting consensus metadata
I20260809 18:56:20.694758 19682 ts_tablet_manager.cc:1918] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:20.694818 18832 catalog_manager.cc:4841] TS 84926f62bf394cc4acab9cc78f726843 (127.16.188.193:35887): tablet ba657a75d04744fa953af3e28b38ce23 (table test-table [id=4c8dfad378594e7c8e4f3fae11345b78]) successfully deleted
I20260809 18:56:20.694890 19682 log.cc:1196] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/ba657a75d04744fa953af3e28b38ce23
I20260809 18:56:20.695312 19682 ts_tablet_manager.cc:1939] T ba657a75d04744fa953af3e28b38ce23 P 24a7ad9cdc4d4c9c80c4d001b91ee0c3: Deleting consensus metadata
I20260809 18:56:20.696293 18836 catalog_manager.cc:4841] TS 24a7ad9cdc4d4c9c80c4d001b91ee0c3 (127.16.188.195:45571): tablet ba657a75d04744fa953af3e28b38ce23 (table test-table [id=4c8dfad378594e7c8e4f3fae11345b78]) successfully deleted
I20260809 18:56:20.698794 19681 ts_tablet_manager.cc:1918] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:20.699030 19681 log.cc:1196] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/ba657a75d04744fa953af3e28b38ce23
I20260809 18:56:20.699755 19681 ts_tablet_manager.cc:1939] T ba657a75d04744fa953af3e28b38ce23 P f6a940efb3d64ef080228e6481c01a69: Deleting consensus metadata
Aug 09 18:56:20 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301779, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:20.700946 18833 catalog_manager.cc:4841] TS f6a940efb3d64ef080228e6481c01a69 (127.16.188.194:37577): tablet ba657a75d04744fa953af3e28b38ce23 (table test-table [id=4c8dfad378594e7c8e4f3fae11345b78]) successfully deleted
I20260809 18:56:20.708287 19643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.678650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60526 (local address 127.16.188.193:35887)
0809 18:56:20.678841 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.678848 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.685178 (+ 6330us) server_negotiation.cc:407] Connection header received
0809 18:56:20.685369 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.685375 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.685454 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.685526 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:20.688793 (+ 3267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.690128 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.692414 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.693289 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.693412 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.701297 (+ 7885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:20.701314 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:20.701333 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:20.701382 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:20.705140 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.705922 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.705932 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.705936 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.706156 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.706506 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.706511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.706514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.707076 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:20.707415 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.707575 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.707806 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 18:56:20.709306 19150 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60526
I20260809 18:56:20.737367 19689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.717788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46772 (local address 127.16.188.254:44655)
0809 18:56:20.718458 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.718466 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.718902 (+ 436us) server_negotiation.cc:407] Connection header received
0809 18:56:20.719065 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.719071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.719153 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.719273 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:20.721357 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.723060 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.724820 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.725893 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.726020 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.729244 (+ 3224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:20.729253 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:20.729258 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:20.729304 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:20.733680 (+ 4376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.734528 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.734533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.734536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.734786 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.735308 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.735313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.735317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.735690 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:20.736001 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.736466 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.736760 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":237,"threads_started":1}
W20260809 18:56:20.738214 18854 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46772
I20260809 18:56:20.740492 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18955
I20260809 18:56:20.762916 19643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.741317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60528 (local address 127.16.188.193:35887)
0809 18:56:20.741486 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.741492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.745576 (+ 4084us) server_negotiation.cc:407] Connection header received
0809 18:56:20.745729 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.745734 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.745810 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.745902 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:20.747554 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.748634 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.750768 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.751408 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.751522 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.755306 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:20.755313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:20.755318 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:20.755362 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:20.759615 (+ 4253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.760549 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.760555 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.760558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.760744 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.761339 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.761344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.761347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.761859 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:20.762159 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.762381 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.762600 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 18:56:20.763648 19150 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60528
W20260809 18:56:20.764220 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18955: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:20.764492 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18955
I20260809 18:56:20.796363 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19164
Aug 09 18:56:20 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301779, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:56:20.812980 19661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.797188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40860 (local address 127.16.188.194:37577)
0809 18:56:20.797371 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.797377 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.797398 (+ 21us) server_negotiation.cc:407] Connection header received
0809 18:56:20.797610 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.797616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.797708 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.797805 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:20.799114 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.799885 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.801267 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.801745 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.801892 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.806518 (+ 4626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:20.806529 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:20.806545 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:20.806601 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:20.809723 (+ 3122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.810677 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.810684 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.810687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.810834 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.811335 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.811339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.811341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.811693 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:20.811946 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.812382 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.812619 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260809 18:56:20.813978 19353 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40860
W20260809 18:56:20.815116 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19164: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:20.815261 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19164
I20260809 18:56:20.848294 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19364
Aug 09 18:56:20 dist-test-slave-266d krb5kdc[18790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301779, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:56:20.863518 19644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:20.849063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44956 (local address 127.16.188.195:45571)
0809 18:56:20.849274 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:20.849280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:20.849361 (+ 81us) server_negotiation.cc:407] Connection header received
0809 18:56:20.849547 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:20.849551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:20.849618 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:20.849725 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:20.850956 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.851705 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.852943 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:20.853574 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:20.853750 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:20.857741 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:20.857758 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:20.857776 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:20.857820 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:20.860739 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.861514 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.861522 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.861524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.861675 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:20.862021 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:20.862025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:20.862027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:20.862410 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:20.862712 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:20.863001 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 18:56:20.863223 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 18:56:20.864142 19549 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44956
W20260809 18:56:20.864727 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19364: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:20.864878 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19364
I20260809 18:56:20.890729 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18812
I20260809 18:56:20.891793 18908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:21.005826 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18812
2026-08-09T18:56:21Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (6036 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:21 dist-test-slave-266d krb5kdc[19699](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:21 dist-test-slave-266d krb5kdc[19699](info): set up 2 sockets
Aug 09 18:56:21 dist-test-slave-266d krb5kdc[19699](info): commencing operation
krb5kdc: starting...
W20260809 18:56:22.196642 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.003s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:22 dist-test-slave-266d krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:22.374614 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:35845
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:45975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:35845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:22.686935 19718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:22.687208 19718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:22.687338 19718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:22.694336 19718 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:22.694437 19718 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:56:22.694499 19718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:22.694592 19718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:22.694659 19718 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:22.694743 19718 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:22.704201 19718 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:45975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:35845
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:35845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:22.705458 19718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:22.706743 19718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:22.717986 19724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:22.717911 19726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:22.717955 19730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:22.718894 19718 server_base.cc:1034] running on GCE node
I20260809 18:56:22.719659 19718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:22.721015 19718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:22.722240 19718 hybrid_clock.cc:648] HybridClock initialized: now 1786301782722179 us; error 33 us; skew 500 ppm
I20260809 18:56:22.722555 19718 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:22 dist-test-slave-266d krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301782, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:22.729404 19718 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:22.730824 19718 webserver.cc:460] Webserver started at http://127.16.188.254:37295/ using document root <none> and password file <none>
I20260809 18:56:22.731501 19718 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:22.731599 19718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:22.731896 19718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:22.734779 19718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "e27b930fdf984c689866ba4a9b28efe4"
format_stamp: "Formatted at 2026-08-09 18:56:22 on dist-test-slave-266d"
server_key: "264b3088e250c04f18a2294798eacfd7"
server_key_iv: "240e30ec217b7245446b23097872adfd"
server_key_version: "encryptionkey@0"
I20260809 18:56:22.735579 19718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "e27b930fdf984c689866ba4a9b28efe4"
format_stamp: "Formatted at 2026-08-09 18:56:22 on dist-test-slave-266d"
server_key: "264b3088e250c04f18a2294798eacfd7"
server_key_iv: "240e30ec217b7245446b23097872adfd"
server_key_version: "encryptionkey@0"
I20260809 18:56:22.740527 19718 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 18:56:22.743745 19744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:22.744918 19718 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:22.745078 19718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "e27b930fdf984c689866ba4a9b28efe4"
format_stamp: "Formatted at 2026-08-09 18:56:22 on dist-test-slave-266d"
server_key: "264b3088e250c04f18a2294798eacfd7"
server_key_iv: "240e30ec217b7245446b23097872adfd"
server_key_version: "encryptionkey@0"
I20260809 18:56:22.745301 19718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:22.760187 19718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:22.763739 19718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:22.763965 19718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:22.785360 19718 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:35845
I20260809 18:56:22.785379 19826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:35845 every 8 connection(s)
I20260809 18:56:22.786713 19718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:22.789593 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19718
I20260809 18:56:22.789825 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:22.790635 17139 external_mini_cluster.cc:1428] Setting key 0c611aa2c87aea653288036db2c0e5fd
I20260809 18:56:22.790736 19827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:22.804399 19827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: Bootstrap starting.
Aug 09 18:56:22 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:22.807350 19827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:22.808362 19827 log.cc:824] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:22.810875 19827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: No bootstrap required, opened a new log
I20260809 18:56:22.812196 19834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:22.792581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57394 (local address 127.16.188.254:35845)
0809 18:56:22.793318 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:22.793328 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:22.793369 (+ 41us) server_negotiation.cc:407] Connection header received
0809 18:56:22.795252 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:22.795272 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:22.795626 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:22.795927 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:22.797673 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:22.798901 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:22.800586 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:22.801293 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:22.801430 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:22.805782 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:22.805791 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:22.805804 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:22.805838 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:22.808620 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:22.809233 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:22.809241 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:22.809247 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:22.809406 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:22.809767 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:22.809770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:22.809772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:22.810235 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:22.810496 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:22.810935 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 18:56:22.811300 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":324,"threads_started":1}
I20260809 18:56:22.818985 19827 raft_consensus.cc:348] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e27b930fdf984c689866ba4a9b28efe4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35845 } }
I20260809 18:56:22.819296 19827 raft_consensus.cc:374] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:22.819381 19827 raft_consensus.cc:729] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27b930fdf984c689866ba4a9b28efe4, State: Initialized, Role: FOLLOWER
I20260809 18:56:22.819932 19827 consensus_queue.cc:260] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e27b930fdf984c689866ba4a9b28efe4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35845 } }
I20260809 18:56:22.820152 19827 raft_consensus.cc:388] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:22.820276 19827 raft_consensus.cc:482] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:22.820427 19827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:22.822501 19827 raft_consensus.cc:504] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e27b930fdf984c689866ba4a9b28efe4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35845 } }
I20260809 18:56:22.822965 19827 leader_election.cc:302] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e27b930fdf984c689866ba4a9b28efe4; no voters:
I20260809 18:56:22.823535 19827 leader_election.cc:288] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:22.823650 19838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:22.824283 19838 raft_consensus.cc:686] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [term 1 LEADER]: Becoming Leader. State: Replica: e27b930fdf984c689866ba4a9b28efe4, State: Running, Role: LEADER
I20260809 18:56:22.824797 19838 consensus_queue.cc:237] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e27b930fdf984c689866ba4a9b28efe4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35845 } }
I20260809 18:56:22.825707 19827 sys_catalog.cc:564] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:22.828117 19842 sys_catalog.cc:455] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e27b930fdf984c689866ba4a9b28efe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e27b930fdf984c689866ba4a9b28efe4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35845 } } }
I20260809 18:56:22.828138 19843 sys_catalog.cc:455] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e27b930fdf984c689866ba4a9b28efe4. Latest consensus state: current_term: 1 leader_uuid: "e27b930fdf984c689866ba4a9b28efe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e27b930fdf984c689866ba4a9b28efe4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35845 } } }
I20260809 18:56:22.828526 19842 sys_catalog.cc:458] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:22.828590 19843 sys_catalog.cc:458] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:22.829859 19847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:22.834662 19847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:22.847555 19847 catalog_manager.cc:1347] Generated new cluster ID: d410878d0d2b451e9ef4f2c7c923b91f
I20260809 18:56:22.847685 19847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:22.868837 19847 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:22.872006 19847 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:22.882798 19847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: Generated new TSK 0
I20260809 18:56:22.883577 19847 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:22.932695 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35845
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:45975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:23.253862 19869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:23.254117 19869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:23.254222 19869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:23.261157 19869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:23.261260 19869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:23.261348 19869 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:56:23.261397 19869 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:23.261467 19869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:23.271006 19869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:45975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:35845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:23.272248 19869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:23.273546 19869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:23.285902 19881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:23.285897 19877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:23.286468 19883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:23.286883 19869 server_base.cc:1034] running on GCE node
I20260809 18:56:23.287487 19869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:23.288362 19869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:23.289552 19869 hybrid_clock.cc:648] HybridClock initialized: now 1786301783289497 us; error 40 us; skew 500 ppm
I20260809 18:56:23.289848 19869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:23 dist-test-slave-266d krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301783, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:23.292841 19869 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:23.294266 19869 webserver.cc:460] Webserver started at http://127.16.188.193:32803/ using document root <none> and password file <none>
I20260809 18:56:23.294898 19869 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:23.295013 19869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:23.295300 19869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:23.298151 19869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "67d2a8ec067f47e5b334f3352ee8b967"
format_stamp: "Formatted at 2026-08-09 18:56:23 on dist-test-slave-266d"
server_key: "9580c64db129a6ee02cc06ab53599648"
server_key_iv: "44a18de61442acaad6187df71dac4e12"
server_key_version: "encryptionkey@0"
I20260809 18:56:23.298889 19869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "67d2a8ec067f47e5b334f3352ee8b967"
format_stamp: "Formatted at 2026-08-09 18:56:23 on dist-test-slave-266d"
server_key: "9580c64db129a6ee02cc06ab53599648"
server_key_iv: "44a18de61442acaad6187df71dac4e12"
server_key_version: "encryptionkey@0"
I20260809 18:56:23.303854 19869 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 18:56:23.307158 19891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:23.308380 19869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:23.308534 19869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "67d2a8ec067f47e5b334f3352ee8b967"
format_stamp: "Formatted at 2026-08-09 18:56:23 on dist-test-slave-266d"
server_key: "9580c64db129a6ee02cc06ab53599648"
server_key_iv: "44a18de61442acaad6187df71dac4e12"
server_key_version: "encryptionkey@0"
I20260809 18:56:23.308710 19869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:23.334081 19869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:23.338280 19869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:23.338542 19869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:23.341217 19869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:23.341327 19869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:23.341434 19869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:23.341513 19869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:56:23 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301783, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:23.364066 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:23.341921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:52003 (local address 127.16.188.254:35845)
0809 18:56:23.342425 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:23.342439 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:23.343500 (+ 1061us) server_negotiation.cc:407] Connection header received
0809 18:56:23.345715 (+ 2215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:23.345721 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:23.345815 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:23.345941 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:23.348066 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.349044 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.351560 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.351971 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.352108 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:23.357217 (+ 5109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:23.357224 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:23.357228 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:23.357271 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:23.360439 (+ 3168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:23.361425 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:23.361429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:23.361431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:23.361556 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:23.362097 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:23.362103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:23.362107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:23.362397 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:23.362548 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:23.363625 (+ 1077us) server_negotiation.cc:299] Negotiation successful
0809 18:56:23.363806 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":256,"threads_started":1}
I20260809 18:56:23.365900 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:23.342445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35845 (local address 127.16.188.193:52003)
0809 18:56:23.343323 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:23.343368 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:23.345379 (+ 2011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:23.346257 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:23.346269 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:23.346981 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:23.347866 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:23.347903 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.349266 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.349270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:23.351418 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:23.351431 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.352220 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.352228 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:23.352553 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:23.353422 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:23.353452 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:23.356883 (+ 3431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:23.360601 (+ 3718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:23.360608 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:23.360625 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:23.361261 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:23.361698 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:23.361704 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:23.361708 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:23.361971 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:23.362534 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:23.362543 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:23.363125 (+ 582us) client_negotiation.cc:769] Sending connection context
0809 18:56:23.363516 (+ 391us) client_negotiation.cc:240] Negotiation successful
0809 18:56:23.364164 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":334,"threads_started":1}
I20260809 18:56:23.385062 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:23.371694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:57305 (local address 127.16.188.254:35845)
0809 18:56:23.371853 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:23.371857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:23.372366 (+ 509us) server_negotiation.cc:407] Connection header received
0809 18:56:23.372487 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:23.372493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:23.372581 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:23.372687 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:23.373755 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.374862 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.376989 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.377457 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.377567 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:23.379239 (+ 1672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:23.379245 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:23.379249 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:23.379279 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:23.382116 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:23.382934 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:23.382948 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:23.382952 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:23.383110 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:23.383564 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:23.383569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:23.383572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:23.383865 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:23.384017 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:23.384640 (+ 623us) server_negotiation.cc:299] Negotiation successful
0809 18:56:23.384815 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 18:56:23.385363 20016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:23.371708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35845 (local address 127.16.188.193:57305)
0809 18:56:23.372263 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:23.372278 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:23.372388 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:23.372697 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:23.372700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:23.373186 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:23.373571 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:23.373586 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.375052 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.375057 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:23.376850 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:23.376866 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.377663 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.377670 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:23.377793 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:23.378355 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:23.378372 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:23.379073 (+ 701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:23.382253 (+ 3180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:23.382259 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:23.382264 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:23.382811 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:23.383222 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:23.383227 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:23.383235 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:23.383404 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:23.383995 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:23.384005 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:23.384265 (+ 260us) client_negotiation.cc:769] Sending connection context
0809 18:56:23.384470 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 18:56:23.384817 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":294,"threads_started":1}
I20260809 18:56:23.390249 19869 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:35225
I20260809 18:56:23.390292 20064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:35225 every 8 connection(s)
I20260809 18:56:23.391518 19869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:23.393450 20065 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35845
I20260809 18:56:23.393676 20065 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:23.394289 20065 heartbeater.cc:511] Master 127.16.188.254:35845 requested a full tablet report, sending...
I20260809 18:56:23.396198 19765 ts_manager.cc:194] Registered new tserver with Master: 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225)
I20260809 18:56:23.397769 19765 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:52003
I20260809 18:56:23.401675 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19869
I20260809 18:56:23.401873 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:23.402456 17139 external_mini_cluster.cc:1428] Setting key bfaaec679b038cc428e62c817973bc62
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:23.444339 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35845
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:45975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:23.760056 20072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:23.760316 20072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:23.760421 20072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:23.767347 20072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:23.767450 20072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:23.767573 20072 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:56:23.767640 20072 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:23.767742 20072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:23.777061 20072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:45975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:35845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:23.778221 20072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:23.779500 20072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:23.791699 20078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:23.791668 20079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:23.792932 20072 server_base.cc:1034] running on GCE node
W20260809 18:56:23.792956 20082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:23.793754 20072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:23.794715 20072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:23.795940 20072 hybrid_clock.cc:648] HybridClock initialized: now 1786301783795877 us; error 53 us; skew 500 ppm
I20260809 18:56:23.796269 20072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:23 dist-test-slave-266d krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301783, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:23.799784 20072 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:23.801223 20072 webserver.cc:460] Webserver started at http://127.16.188.194:35133/ using document root <none> and password file <none>
I20260809 18:56:23.801828 20072 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:23.801936 20072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:23.802232 20072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:23.804917 20072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "deb7f462ac70426dbac86067df931acc"
format_stamp: "Formatted at 2026-08-09 18:56:23 on dist-test-slave-266d"
server_key: "daabf60e2e00fa2e08cfddca81ff29f3"
server_key_iv: "69ccae5e597916c16cd6763e5abb7d4c"
server_key_version: "encryptionkey@0"
I20260809 18:56:23.805723 20072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "deb7f462ac70426dbac86067df931acc"
format_stamp: "Formatted at 2026-08-09 18:56:23 on dist-test-slave-266d"
server_key: "daabf60e2e00fa2e08cfddca81ff29f3"
server_key_iv: "69ccae5e597916c16cd6763e5abb7d4c"
server_key_version: "encryptionkey@0"
I20260809 18:56:23.810451 20072 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 18:56:23.813665 20089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:23.814859 20072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:23.814996 20072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "deb7f462ac70426dbac86067df931acc"
format_stamp: "Formatted at 2026-08-09 18:56:23 on dist-test-slave-266d"
server_key: "daabf60e2e00fa2e08cfddca81ff29f3"
server_key_iv: "69ccae5e597916c16cd6763e5abb7d4c"
server_key_version: "encryptionkey@0"
I20260809 18:56:23.815164 20072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:23.833755 20072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:23.837365 20072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:23.837634 20072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:23.840987 20072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:23.841187 20072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:23.841338 20072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:23.841445 20072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:56:23 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301783, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:23.863457 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:23.843551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:60303 (local address 127.16.188.254:35845)
0809 18:56:23.843798 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:23.843804 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:23.843827 (+ 23us) server_negotiation.cc:407] Connection header received
0809 18:56:23.845961 (+ 2134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:23.845968 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:23.846050 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:23.846136 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:23.847740 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.848564 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.851095 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.851644 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.851759 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:23.856696 (+ 4937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:23.856702 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:23.856706 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:23.856749 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:23.860127 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:23.861017 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:23.861023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:23.861026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:23.861233 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:23.861667 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:23.861672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:23.861676 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:23.862097 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:23.862252 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:23.862844 (+ 592us) server_negotiation.cc:299] Negotiation successful
0809 18:56:23.863087 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260809 18:56:23.864171 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:23.841920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35845 (local address 127.16.188.194:60303)
0809 18:56:23.842974 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:23.843025 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:23.845636 (+ 2611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:23.846446 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:23.846461 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:23.847022 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:23.847567 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:23.847585 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.848745 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.848751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:23.850913 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:23.850933 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.851905 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.851913 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:23.852165 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:23.853000 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:23.853037 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:23.856437 (+ 3400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:23.860319 (+ 3882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:23.860329 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:23.860348 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:23.860877 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:23.861365 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:23.861371 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:23.861375 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:23.861557 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:23.862202 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:23.862207 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:23.862519 (+ 312us) client_negotiation.cc:769] Sending connection context
0809 18:56:23.862731 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 18:56:23.863080 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":432,"threads_started":1}
I20260809 18:56:23.884861 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:23.870960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:52463 (local address 127.16.188.254:35845)
0809 18:56:23.871126 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:23.871132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:23.871919 (+ 787us) server_negotiation.cc:407] Connection header received
0809 18:56:23.872074 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:23.872077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:23.872134 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:23.872205 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:23.873551 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.874659 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.877030 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.877532 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.877624 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:23.879900 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:23.879904 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:23.879907 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:23.879937 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:23.882422 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:23.883207 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:23.883211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:23.883213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:23.883338 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:23.883676 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:23.883678 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:23.883680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:23.883967 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:23.884075 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:23.884476 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 18:56:23.884635 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 18:56:23.885269 20200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:23.871040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35845 (local address 127.16.188.194:52463)
0809 18:56:23.871804 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:23.871831 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:23.871972 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:23.872247 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:23.872252 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:23.872902 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:23.873349 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:23.873367 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.874857 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.874862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:23.876799 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:23.876818 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:23.877696 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:23.877702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:23.877866 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:23.878458 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:23.878482 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:23.879709 (+ 1227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:23.882546 (+ 2837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:23.882552 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:23.882557 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:23.883096 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:23.883429 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:23.883433 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:23.883437 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:23.883584 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:23.884060 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:23.884066 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:23.884268 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 18:56:23.884417 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 18:56:23.884764 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":442,"threads_started":1}
I20260809 18:56:23.891074 20072 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:33947
I20260809 18:56:23.891129 20260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:33947 every 8 connection(s)
I20260809 18:56:23.892231 20072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:23.894107 20261 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35845
I20260809 18:56:23.894312 20261 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:23.894943 20261 heartbeater.cc:511] Master 127.16.188.254:35845 requested a full tablet report, sending...
I20260809 18:56:23.896188 19765 ts_manager.cc:194] Registered new tserver with Master: deb7f462ac70426dbac86067df931acc (127.16.188.194:33947)
I20260809 18:56:23.896983 19765 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:60303
I20260809 18:56:23.900630 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20072
I20260809 18:56:23.900805 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:23.901247 17139 external_mini_cluster.cc:1428] Setting key f081dc24042ad00422e5f7e0abd503d9
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:56:23.941854 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35845
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:45975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:24.257979 20267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:24.258260 20267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:24.258412 20267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:24.265383 20267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:24.265491 20267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:24.265623 20267 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:56:24.265691 20267 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:56:24.265792 20267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:24.275607 20267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:45975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:35845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:24.276842 20267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:24.278126 20267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:24.290627 20275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:24.290664 20276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:24.290707 20278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:24.291831 20267 server_base.cc:1034] running on GCE node
I20260809 18:56:24.292364 20267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:24.293252 20267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:24.294446 20267 hybrid_clock.cc:648] HybridClock initialized: now 1786301784294401 us; error 40 us; skew 500 ppm
I20260809 18:56:24.294729 20267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:24 dist-test-slave-266d krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301784, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:24.297700 20267 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:24.299049 20267 webserver.cc:460] Webserver started at http://127.16.188.195:34855/ using document root <none> and password file <none>
I20260809 18:56:24.299640 20267 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:24.299739 20267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:24.299993 20267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:24.302680 20267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "ef0f7e09370042f6a92e16a6f4e463f4"
format_stamp: "Formatted at 2026-08-09 18:56:24 on dist-test-slave-266d"
server_key: "3637410b30fb380f4c6c14bd91e6d497"
server_key_iv: "70bcf22fce18edf3292762508e00f1b5"
server_key_version: "encryptionkey@0"
I20260809 18:56:24.303357 20267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "ef0f7e09370042f6a92e16a6f4e463f4"
format_stamp: "Formatted at 2026-08-09 18:56:24 on dist-test-slave-266d"
server_key: "3637410b30fb380f4c6c14bd91e6d497"
server_key_iv: "70bcf22fce18edf3292762508e00f1b5"
server_key_version: "encryptionkey@0"
I20260809 18:56:24.308041 20267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 18:56:24.311233 20288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:24.312453 20267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 18:56:24.312598 20267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "ef0f7e09370042f6a92e16a6f4e463f4"
format_stamp: "Formatted at 2026-08-09 18:56:24 on dist-test-slave-266d"
server_key: "3637410b30fb380f4c6c14bd91e6d497"
server_key_iv: "70bcf22fce18edf3292762508e00f1b5"
server_key_version: "encryptionkey@0"
I20260809 18:56:24.312760 20267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:24.338665 20267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:24.342475 20267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:24.342797 20267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:24.345516 20267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:24.345651 20267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:24.346051 20267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:24.346150 20267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:56:24 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301784, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:24.367964 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.345889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:57219 (local address 127.16.188.254:35845)
0809 18:56:24.346065 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.346070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.347429 (+ 1359us) server_negotiation.cc:407] Connection header received
0809 18:56:24.349499 (+ 2070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.349504 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.349589 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.349687 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:24.351780 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.352968 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.355585 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.355997 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.356110 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.360971 (+ 4861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:24.360976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:24.360980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:24.361016 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:24.364245 (+ 3229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:24.365123 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:24.365130 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:24.365134 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:24.365270 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:24.365806 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:24.365811 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:24.365815 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:24.366176 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:24.366324 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.367391 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.367617 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 18:56:24.368916 20302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.346496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35845 (local address 127.16.188.195:57219)
0809 18:56:24.347283 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.347319 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.349227 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.349950 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.349958 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.350643 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:24.351560 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.351588 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.353185 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.353191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.355374 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.355394 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.356264 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.356272 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.356503 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.357406 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:24.357450 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:24.360706 (+ 3256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:24.364362 (+ 3656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:24.364375 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:24.364394 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:24.364972 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:24.365384 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:24.365389 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:24.365393 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:24.365691 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:24.366389 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:24.366394 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:24.366857 (+ 463us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.367185 (+ 328us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.367696 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":318,"threads_started":1}
I20260809 18:56:24.387774 20396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.374504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35845 (local address 127.16.188.195:60739)
0809 18:56:24.375069 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.375088 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.375254 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.375589 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.375594 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.376192 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:24.376659 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.376673 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.377917 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.377922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.379503 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.379516 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.380235 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.380241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.380374 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.380945 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:24.380961 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:24.381757 (+ 796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:24.385056 (+ 3299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:24.385062 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:24.385070 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:24.385649 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:24.385989 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:24.385994 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:24.385998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:24.386120 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:24.386774 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:24.386778 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:24.386931 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.387085 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.387397 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":288,"threads_started":1}
I20260809 18:56:24.387814 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.374563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:60739 (local address 127.16.188.254:35845)
0809 18:56:24.374706 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.374710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.375186 (+ 476us) server_negotiation.cc:407] Connection header received
0809 18:56:24.375381 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.375386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.375457 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.375539 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:24.376797 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.377791 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.379641 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.380052 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.380165 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.381937 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:24.381943 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:24.381947 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:24.381977 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:24.384893 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:24.385757 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:24.385763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:24.385766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:24.385889 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:24.386240 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:24.386246 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:24.386250 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:24.386642 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:24.386814 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.387201 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.387442 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 18:56:24.398831 20267 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:35267
I20260809 18:56:24.398895 20447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:35267 every 8 connection(s)
I20260809 18:56:24.399950 20267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:24.400362 20065 heartbeater.cc:503] Master 127.16.188.254:35845 was elected leader, sending a full tablet report...
I20260809 18:56:24.402055 20448 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35845
I20260809 18:56:24.402268 20448 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:24.402853 20448 heartbeater.cc:511] Master 127.16.188.254:35845 requested a full tablet report, sending...
I20260809 18:56:24.404053 19764 ts_manager.cc:194] Registered new tserver with Master: ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267)
I20260809 18:56:24.404876 19764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:57219
I20260809 18:56:24.407534 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20267
I20260809 18:56:24.407712 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:24.408109 17139 external_mini_cluster.cc:1428] Setting key 1c1d6b211ad1122566463e97bbccfebd
I20260809 18:56:24.410789 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:24 dist-test-slave-266d krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:56:24 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:24.458118 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.444704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57408 (local address 127.16.188.254:35845)
0809 18:56:24.444913 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.444920 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.445230 (+ 310us) server_negotiation.cc:407] Connection header received
0809 18:56:24.445423 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.445427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.445506 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.445588 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:24.446979 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.447717 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.448990 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.449521 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.449645 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.453223 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:24.453228 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:24.453231 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:24.453265 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:24.455679 (+ 2414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:24.456265 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:24.456269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:24.456271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:24.456407 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:24.456751 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:24.456754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:24.456756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:24.457031 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:24.457292 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.457560 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.457789 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 18:56:24.462005 19764 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57408:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:24.468782 19764 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:24.504395 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.481283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39590 (local address 127.16.188.194:33947)
0809 18:56:24.496406 (+ 15123us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.496414 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.496445 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:56:24.496558 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.496566 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.496825 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.497036 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:24.497943 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.499524 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.502025 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.503279 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.503448 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.503624 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.503942 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.504113 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14942,"thread_start_us":15934,"threads_started":1}
I20260809 18:56:24.504448 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.480722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:33947 (local address 127.0.0.1:39590)
0809 18:56:24.495742 (+ 15020us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.495762 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.495886 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.497036 (+ 1150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.497043 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.497070 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:24.497533 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.497562 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.499692 (+ 2130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.499698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.501851 (+ 2153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.501866 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.503497 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.503504 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.503712 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.503751 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.503861 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.504055 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14884,"mutex_wait_us":6,"thread_start_us":12407,"threads_started":1}
I20260809 18:56:24.505656 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.480522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:35225 (local address 127.0.0.1:32858)
0809 18:56:24.492703 (+ 12181us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.492744 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.492933 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.499056 (+ 6123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.499061 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.499084 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:24.499461 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.499474 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.501203 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.501209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.502782 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.502795 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.504813 (+ 2018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.504820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.505021 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.505053 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.505163 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.505287 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11892,"mutex_wait_us":23,"thread_start_us":15439,"threads_started":1}
I20260809 18:56:24.506004 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.481142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32858 (local address 127.16.188.193:35225)
0809 18:56:24.498635 (+ 17493us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.498641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.498663 (+ 22us) server_negotiation.cc:407] Connection header received
0809 18:56:24.498734 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.498739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.498886 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.499047 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:24.499650 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.501072 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.502934 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.504345 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.504509 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.504667 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.505547 (+ 880us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.505723 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17355,"thread_start_us":18047,"threads_started":1}
I20260809 18:56:24.507839 20470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.496571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:35267 (local address 127.0.0.1:35820)
0809 18:56:24.497781 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.497797 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.497895 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.500449 (+ 2554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.500454 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.500478 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:24.500936 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.500947 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.502996 (+ 2049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.503001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.505326 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.505340 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.507050 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.507058 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.507225 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.507257 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.507354 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.507470 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1096,"mutex_wait_us":1,"thread_start_us":1146,"threads_started":1}
I20260809 18:56:24.507861 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.496743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35820 (local address 127.16.188.195:35267)
0809 18:56:24.499900 (+ 3157us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.499908 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.499939 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:56:24.500031 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.500038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.500247 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.501162 (+ 915us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:24.501442 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.502814 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.505477 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.506829 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.507042 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.507209 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.507400 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.507552 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2980,"thread_start_us":2768,"threads_started":1}
I20260809 18:56:24.508764 20158 tablet_service.cc:1467] Processing CreateTablet for tablet 4972ba9d1665416c99e6ba8eeb6a0130 (DEFAULT_TABLE table=test-table [id=a04ec19357a24f27b87ff96a95d00346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:24.509470 19962 tablet_service.cc:1467] Processing CreateTablet for tablet 4972ba9d1665416c99e6ba8eeb6a0130 (DEFAULT_TABLE table=test-table [id=a04ec19357a24f27b87ff96a95d00346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:24.510260 20158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4972ba9d1665416c99e6ba8eeb6a0130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.510591 19962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4972ba9d1665416c99e6ba8eeb6a0130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.511507 20355 tablet_service.cc:1467] Processing CreateTablet for tablet 4972ba9d1665416c99e6ba8eeb6a0130 (DEFAULT_TABLE table=test-table [id=a04ec19357a24f27b87ff96a95d00346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:24.512847 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4972ba9d1665416c99e6ba8eeb6a0130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.521857 20472 tablet_bootstrap.cc:492] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Bootstrap starting.
I20260809 18:56:24.524734 20473 tablet_bootstrap.cc:492] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Bootstrap starting.
I20260809 18:56:24.525041 20472 tablet_bootstrap.cc:654] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.527271 20472 log.cc:824] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:24.529165 20474 tablet_bootstrap.cc:492] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Bootstrap starting.
I20260809 18:56:24.529224 20473 tablet_bootstrap.cc:654] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.530388 20472 tablet_bootstrap.cc:492] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: No bootstrap required, opened a new log
I20260809 18:56:24.530438 20473 log.cc:824] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:24.530676 20472 ts_tablet_manager.cc:1397] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 18:56:24.532014 20474 tablet_bootstrap.cc:654] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.533025 20474 log.cc:824] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:24.533310 20473 tablet_bootstrap.cc:492] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: No bootstrap required, opened a new log
I20260809 18:56:24.533612 20473 ts_tablet_manager.cc:1397] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260809 18:56:24.535576 20474 tablet_bootstrap.cc:492] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: No bootstrap required, opened a new log
I20260809 18:56:24.535809 20474 ts_tablet_manager.cc:1397] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 18:56:24.540982 20472 raft_consensus.cc:348] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.541435 20472 raft_consensus.cc:374] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.541538 20472 raft_consensus.cc:729] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d2a8ec067f47e5b334f3352ee8b967, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.542126 20472 consensus_queue.cc:260] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.542898 20474 raft_consensus.cc:348] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.543285 20474 raft_consensus.cc:374] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.543381 20474 raft_consensus.cc:729] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f7e09370042f6a92e16a6f4e463f4, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.543826 20472 ts_tablet_manager.cc:1428] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260809 18:56:24.543891 20474 consensus_queue.cc:260] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.544916 20448 heartbeater.cc:503] Master 127.16.188.254:35845 was elected leader, sending a full tablet report...
I20260809 18:56:24.545509 20474 ts_tablet_manager.cc:1428] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260809 18:56:24.544513 20473 raft_consensus.cc:348] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.546404 20473 raft_consensus.cc:374] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.546518 20473 raft_consensus.cc:729] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb7f462ac70426dbac86067df931acc, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.547094 20473 consensus_queue.cc:260] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.548153 20261 heartbeater.cc:503] Master 127.16.188.254:35845 was elected leader, sending a full tablet report...
I20260809 18:56:24.548808 20473 ts_tablet_manager.cc:1428] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Time spent starting tablet: real 0.015s user 0.009s sys 0.002s
I20260809 18:56:24.581387 20480 raft_consensus.cc:482] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:24.581676 20480 raft_consensus.cc:504] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.583267 20480 leader_election.cc:288] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deb7f462ac70426dbac86067df931acc (127.16.188.194:33947), ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267)
I20260809 18:56:24.589682 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.584155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:53259 (local address 127.16.188.195:35267)
0809 18:56:24.584339 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.584345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.584652 (+ 307us) server_negotiation.cc:407] Connection header received
0809 18:56:24.584806 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.584811 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.584870 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.584943 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:24.585573 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.586266 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.587992 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.588746 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.588890 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.588965 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.589302 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.589430 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 18:56:24.589777 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.583606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:50153 (local address 127.16.188.194:33947)
0809 18:56:24.583816 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.583823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.584459 (+ 636us) server_negotiation.cc:407] Connection header received
0809 18:56:24.584667 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.584673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.584736 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.584809 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:24.585460 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.586192 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.588102 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.588851 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.588993 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.589062 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.589394 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.589518 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 18:56:24.589793 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.583682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:35267 (local address 127.16.188.193:53259)
0809 18:56:24.584525 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.584547 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.584681 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.584978 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.584982 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.585022 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:24.585418 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.585428 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.586406 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.586410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.587833 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.587845 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.588937 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.588943 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.589083 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.589183 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.589267 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.589388 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":43,"thread_start_us":658,"threads_started":1}
I20260809 18:56:24.589964 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.583633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:33947 (local address 127.16.188.193:50153)
0809 18:56:24.584359 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.584375 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.584520 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.584841 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.584845 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.584870 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:24.585319 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.585333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.586316 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.586322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.587965 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.587978 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.589066 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.589073 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.589250 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.589273 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.589351 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.589471 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"mutex_wait_us":38,"spinlock_wait_cycles":15616,"thread_start_us":389,"threads_started":1}
I20260809 18:56:24.590902 20194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4972ba9d1665416c99e6ba8eeb6a0130" candidate_uuid: "67d2a8ec067f47e5b334f3352ee8b967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb7f462ac70426dbac86067df931acc" is_pre_election: true
I20260809 18:56:24.590901 20387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4972ba9d1665416c99e6ba8eeb6a0130" candidate_uuid: "67d2a8ec067f47e5b334f3352ee8b967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" is_pre_election: true
I20260809 18:56:24.591427 20194 raft_consensus.cc:2454] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67d2a8ec067f47e5b334f3352ee8b967 in term 0.
I20260809 18:56:24.591427 20387 raft_consensus.cc:2454] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67d2a8ec067f47e5b334f3352ee8b967 in term 0.
I20260809 18:56:24.592036 19894 leader_election.cc:302] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, ef0f7e09370042f6a92e16a6f4e463f4; no voters:
I20260809 18:56:24.592387 20480 raft_consensus.cc:2781] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:24.592506 20480 raft_consensus.cc:482] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:24.592598 20480 raft_consensus.cc:3037] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:24.594779 20480 raft_consensus.cc:504] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.595384 20480 leader_election.cc:288] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [CANDIDATE]: Term 1 election: Requested vote from peers deb7f462ac70426dbac86067df931acc (127.16.188.194:33947), ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267)
I20260809 18:56:24.595731 20194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4972ba9d1665416c99e6ba8eeb6a0130" candidate_uuid: "67d2a8ec067f47e5b334f3352ee8b967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb7f462ac70426dbac86067df931acc"
I20260809 18:56:24.595790 20387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4972ba9d1665416c99e6ba8eeb6a0130" candidate_uuid: "67d2a8ec067f47e5b334f3352ee8b967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f7e09370042f6a92e16a6f4e463f4"
I20260809 18:56:24.595914 20194 raft_consensus.cc:3037] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:24.595939 20387 raft_consensus.cc:3037] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:24.598079 20194 raft_consensus.cc:2454] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d2a8ec067f47e5b334f3352ee8b967 in term 1.
I20260809 18:56:24.598133 20387 raft_consensus.cc:2454] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d2a8ec067f47e5b334f3352ee8b967 in term 1.
I20260809 18:56:24.598434 19892 leader_election.cc:302] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, deb7f462ac70426dbac86067df931acc; no voters:
I20260809 18:56:24.598701 20480 raft_consensus.cc:2781] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:24.599078 20480 raft_consensus.cc:686] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 LEADER]: Becoming Leader. State: Replica: 67d2a8ec067f47e5b334f3352ee8b967, State: Running, Role: LEADER
I20260809 18:56:24.599545 20480 consensus_queue.cc:237] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.603609 19763 catalog_manager.cc:5495] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193). New cstate: current_term: 1 leader_uuid: "67d2a8ec067f47e5b334f3352ee8b967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } health_report { overall_health: UNKNOWN } } }
W20260809 18:56:24.643879 20066 tablet.cc:2369] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:56:24.644071 20263 tablet.cc:2369] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 18:56:24 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301782, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
W20260809 18:56:24.651486 20449 tablet.cc:2369] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:24.655766 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.643270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35845 (local address 127.0.0.1:57422)
0809 18:56:24.643816 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.643843 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.643990 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.644386 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.644391 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.645214 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:24.645479 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.645488 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.646457 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.646461 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.647415 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.647426 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.648082 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.648087 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.648213 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.648769 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:24.648786 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:24.650821 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:24.653578 (+ 2757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:24.653594 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:24.653599 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:24.654020 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:24.654341 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:24.654344 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:24.654346 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:24.654473 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:24.654964 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:24.654970 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:24.655143 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.655274 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.655455 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":262,"threads_started":1}
I20260809 18:56:24.655791 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.643202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57422 (local address 127.16.188.254:35845)
0809 18:56:24.643349 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.643354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.643936 (+ 582us) server_negotiation.cc:407] Connection header received
0809 18:56:24.644148 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.644153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.644244 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.644349 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:24.645622 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.646353 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.647528 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.647915 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.648006 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.650993 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:24.650997 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:24.651000 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:24.651030 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:24.653471 (+ 2441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:24.654129 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:24.654133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:24.654135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:24.654251 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:24.654558 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:24.654561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:24.654562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:24.654858 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:24.654984 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.655374 (+ 390us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.655554 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":46}
I20260809 18:56:24.660327 19763 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:57422:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:56:24.661389 19763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:24.667431 19962 tablet_service.cc:1467] Processing CreateTablet for tablet 3f8e0912fba44f2faf24e89fd5999e6f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=411140ca14224d3db6f5f591f6f4ee76]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:24.667485 20158 tablet_service.cc:1467] Processing CreateTablet for tablet 3f8e0912fba44f2faf24e89fd5999e6f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=411140ca14224d3db6f5f591f6f4ee76]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:24.667822 20355 tablet_service.cc:1467] Processing CreateTablet for tablet 3f8e0912fba44f2faf24e89fd5999e6f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=411140ca14224d3db6f5f591f6f4ee76]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:56:24.668402 20158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f8e0912fba44f2faf24e89fd5999e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.668406 19962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f8e0912fba44f2faf24e89fd5999e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.668655 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f8e0912fba44f2faf24e89fd5999e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.674695 20474 tablet_bootstrap.cc:492] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: Bootstrap starting.
I20260809 18:56:24.675407 20472 tablet_bootstrap.cc:492] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: Bootstrap starting.
I20260809 18:56:24.675825 20473 tablet_bootstrap.cc:492] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: Bootstrap starting.
I20260809 18:56:24.676297 20474 tablet_bootstrap.cc:654] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.676956 20472 tablet_bootstrap.cc:654] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.677356 20473 tablet_bootstrap.cc:654] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.679232 20474 tablet_bootstrap.cc:492] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: No bootstrap required, opened a new log
I20260809 18:56:24.679229 20472 tablet_bootstrap.cc:492] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: No bootstrap required, opened a new log
I20260809 18:56:24.679364 20474 ts_tablet_manager.cc:1397] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 18:56:24.679368 20472 ts_tablet_manager.cc:1397] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:56:24.679971 20474 raft_consensus.cc:348] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.680164 20474 raft_consensus.cc:374] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.680253 20474 raft_consensus.cc:729] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f7e09370042f6a92e16a6f4e463f4, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.680145 20472 raft_consensus.cc:348] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.680383 20472 raft_consensus.cc:374] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.680476 20472 raft_consensus.cc:729] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d2a8ec067f47e5b334f3352ee8b967, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.680469 20474 consensus_queue.cc:260] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.680701 20472 consensus_queue.cc:260] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.681113 20474 ts_tablet_manager.cc:1428] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:24.681277 20472 ts_tablet_manager.cc:1428] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:56:24.681002 20483 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.681401 20483 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:24.681565 20480 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.681831 20480 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:24.683722 20473 tablet_bootstrap.cc:492] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: No bootstrap required, opened a new log
I20260809 18:56:24.683854 20473 ts_tablet_manager.cc:1397] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 18:56:24.684410 20473 raft_consensus.cc:348] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.684619 20473 raft_consensus.cc:374] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.684720 20473 raft_consensus.cc:729] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb7f462ac70426dbac86067df931acc, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.684919 20473 consensus_queue.cc:260] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.685518 20473 ts_tablet_manager.cc:1428] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:56:24.685362 20484 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.685729 20484 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:24.718505 20484 raft_consensus.cc:482] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:24.718724 20484 raft_consensus.cc:504] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.720218 20484 leader_election.cc:288] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225), ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267)
I20260809 18:56:24.727499 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.720544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:47685 (local address 127.16.188.193:35225)
0809 18:56:24.720716 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.720720 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.721375 (+ 655us) server_negotiation.cc:407] Connection header received
0809 18:56:24.721666 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.721672 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.721761 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.721822 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:24.722535 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.723463 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.725542 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.726609 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.726736 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.726798 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.727172 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.727275 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 18:56:24.727722 20504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.720588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:35225 (local address 127.16.188.194:47685)
0809 18:56:24.721273 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.721292 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.721494 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.722000 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.722003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.722028 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:24.722358 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.722372 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.723585 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.723591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.725384 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.725397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.726835 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.726842 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.727011 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.727046 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.727160 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.727305 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":2,"thread_start_us":365,"threads_started":1}
I20260809 18:56:24.728202 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.721551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:33615 (local address 127.16.188.195:35267)
0809 18:56:24.721753 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.721759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.722265 (+ 506us) server_negotiation.cc:407] Connection header received
0809 18:56:24.722421 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.722426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.722501 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.722570 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:24.723166 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.724159 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.726220 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.727272 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.727406 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.727476 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.727828 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.727952 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 18:56:24.728255 20505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.721422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:35267 (local address 127.16.188.194:33615)
0809 18:56:24.722161 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.722175 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.722284 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.722613 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.722618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.722644 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:24.723032 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.723043 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.724294 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.724298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.726056 (+ 1758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.726070 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.727482 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.727489 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.727665 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.727702 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.727791 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.727904 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":3,"thread_start_us":449,"threads_started":1}
I20260809 18:56:24.728624 19993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f8e0912fba44f2faf24e89fd5999e6f" candidate_uuid: "deb7f462ac70426dbac86067df931acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d2a8ec067f47e5b334f3352ee8b967" is_pre_election: true
I20260809 18:56:24.728966 20387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f8e0912fba44f2faf24e89fd5999e6f" candidate_uuid: "deb7f462ac70426dbac86067df931acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" is_pre_election: true
I20260809 18:56:24.729075 19993 raft_consensus.cc:2454] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb7f462ac70426dbac86067df931acc in term 0.
I20260809 18:56:24.729228 20387 raft_consensus.cc:2454] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb7f462ac70426dbac86067df931acc in term 0.
I20260809 18:56:24.729646 20092 leader_election.cc:302] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: deb7f462ac70426dbac86067df931acc, ef0f7e09370042f6a92e16a6f4e463f4; no voters:
I20260809 18:56:24.729992 20484 raft_consensus.cc:2781] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:24.730118 20484 raft_consensus.cc:482] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:24.730221 20484 raft_consensus.cc:3037] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:24.732359 20484 raft_consensus.cc:504] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.732868 20484 leader_election.cc:288] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [CANDIDATE]: Term 1 election: Requested vote from peers 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225), ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267)
I20260809 18:56:24.733335 19993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f8e0912fba44f2faf24e89fd5999e6f" candidate_uuid: "deb7f462ac70426dbac86067df931acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d2a8ec067f47e5b334f3352ee8b967"
I20260809 18:56:24.733404 20387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f8e0912fba44f2faf24e89fd5999e6f" candidate_uuid: "deb7f462ac70426dbac86067df931acc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f7e09370042f6a92e16a6f4e463f4"
I20260809 18:56:24.733525 19993 raft_consensus.cc:3037] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:24.733592 20387 raft_consensus.cc:3037] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:24.736433 20387 raft_consensus.cc:2454] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb7f462ac70426dbac86067df931acc in term 1.
I20260809 18:56:24.736447 19993 raft_consensus.cc:2454] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb7f462ac70426dbac86067df931acc in term 1.
I20260809 18:56:24.736790 20092 leader_election.cc:302] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, deb7f462ac70426dbac86067df931acc; no voters:
I20260809 18:56:24.737064 20484 raft_consensus.cc:2781] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:24.737473 20484 raft_consensus.cc:686] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [term 1 LEADER]: Becoming Leader. State: Replica: deb7f462ac70426dbac86067df931acc, State: Running, Role: LEADER
I20260809 18:56:24.737905 20484 consensus_queue.cc:237] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.740916 20507 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: TxnStatusTablet state changed. Reason: New leader deb7f462ac70426dbac86067df931acc. Latest consensus state: current_term: 1 leader_uuid: "deb7f462ac70426dbac86067df931acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.741253 20507 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:24.742007 20514 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:56:24.742247 20514 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:56:24.742689 19765 catalog_manager.cc:5495] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc reported cstate change: term changed from 0 to 1, leader changed from <none> to deb7f462ac70426dbac86067df931acc (127.16.188.194). New cstate: current_term: 1 leader_uuid: "deb7f462ac70426dbac86067df931acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:24.762899 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.757071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:33947 (local address 127.0.0.1:39606)
0809 18:56:24.757346 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.757362 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.757470 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.757908 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.757911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.757920 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:24.758067 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.758074 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.759461 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.759464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.760419 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.760430 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.761401 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.761406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.761550 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.761603 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:24.762507 (+ 904us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:24.762517 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.762559 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.762670 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 18:56:24.762980 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.757048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39606 (local address 127.16.188.194:33947)
0809 18:56:24.757259 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.757265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.757427 (+ 162us) server_negotiation.cc:407] Connection header received
0809 18:56:24.757647 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.757652 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.757756 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.757907 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:24.758191 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.759356 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.760554 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.761238 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.761386 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.761780 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:24.762413 (+ 633us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:24.762543 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.762592 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.762678 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 18:56:24.770045 19993 raft_consensus.cc:1261] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Refusing update from remote peer deb7f462ac70426dbac86067df931acc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:24.770197 20387 raft_consensus.cc:1261] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Refusing update from remote peer deb7f462ac70426dbac86067df931acc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:24.770910 20507 consensus_queue.cc:1035] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:24.771306 20484 consensus_queue.cc:1035] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:24.782327 20480 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: TxnStatusTablet state changed. Reason: New leader deb7f462ac70426dbac86067df931acc. Latest consensus state: current_term: 1 leader_uuid: "deb7f462ac70426dbac86067df931acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.782665 20480 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:24.784317 20519 mvcc.cc:205] Tried to move back new op lower bound from 7316692110409043968 to 7316692110289903616. Current Snapshot: MvccSnapshot[applied={T|T < 7316692110409043968}]
I20260809 18:56:24.785801 20484 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "deb7f462ac70426dbac86067df931acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.786055 20484 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:24.789227 20522 mvcc.cc:205] Tried to move back new op lower bound from 7316692110409043968 to 7316692110289903616. Current Snapshot: MvccSnapshot[applied={T|T < 7316692110409043968}]
I20260809 18:56:24.805620 20483 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: TxnStatusTablet state changed. Reason: New leader deb7f462ac70426dbac86067df931acc. Latest consensus state: current_term: 1 leader_uuid: "deb7f462ac70426dbac86067df931acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.805919 20483 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:24.809523 20507 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "deb7f462ac70426dbac86067df931acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.809764 20507 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P deb7f462ac70426dbac86067df931acc: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:56:24.810503 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.803226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32868 (local address 127.16.188.193:35225)
0809 18:56:24.803392 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.803397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.803415 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:56:24.803502 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.803508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.803622 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.803765 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:24.804320 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.805522 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.807332 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.807944 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.808072 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.808694 (+ 622us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:24.809390 (+ 696us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:24.809538 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.810101 (+ 563us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.810179 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 18:56:24.814466 20483 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "deb7f462ac70426dbac86067df931acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.814706 20483 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P ef0f7e09370042f6a92e16a6f4e463f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:24.815989 20480 tablet_replica.cc:439] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "deb7f462ac70426dbac86067df931acc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } } }
I20260809 18:56:24.816277 20480 tablet_replica.cc:442] T 3f8e0912fba44f2faf24e89fd5999e6f P 67d2a8ec067f47e5b334f3352ee8b967: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:56:24.833600 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.828024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:38465 (local address 127.16.188.194:33947)
0809 18:56:24.828241 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.828248 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.828645 (+ 397us) server_negotiation.cc:407] Connection header received
0809 18:56:24.828820 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.828825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.828891 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.828969 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:24.829612 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.830379 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.831738 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.832236 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.832345 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.832807 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:24.832914 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:24.832996 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.833167 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.833248 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 18:56:24.833639 20537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.827933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:33947 (local address 127.16.188.193:38465)
0809 18:56:24.828538 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.828554 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.828699 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.828998 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.829003 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.829015 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:24.829450 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.829465 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.830503 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.830509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.831593 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.831606 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.832429 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.832437 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.832555 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.832616 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:24.833010 (+ 394us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:24.833041 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.833142 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.833271 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":318,"threads_started":1}
I20260809 18:56:24.843210 20387 raft_consensus.cc:1261] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Refusing update from remote peer 67d2a8ec067f47e5b334f3352ee8b967: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:24.843448 20194 raft_consensus.cc:1261] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Refusing update from remote peer 67d2a8ec067f47e5b334f3352ee8b967: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:24.844094 20488 consensus_queue.cc:1035] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:24.844446 20480 consensus_queue.cc:1035] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:24.882781 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.875409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:42687 (local address 127.16.188.193:35225)
0809 18:56:24.875604 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:24.875611 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:24.877753 (+ 2142us) server_negotiation.cc:407] Connection header received
0809 18:56:24.877915 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:24.877919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:24.877978 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:24.878046 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:24.878684 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.879499 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.881167 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.881588 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.881700 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.882115 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:24.882208 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:24.882278 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:24.882426 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 18:56:24.882501 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:56:24.882941 20548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:24.875477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:35225 (local address 127.16.188.194:42687)
0809 18:56:24.877642 (+ 2165us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:24.877662 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:24.877805 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:24.878077 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:24.878082 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:24.878095 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:24.878503 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.878514 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.879637 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.879643 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.881016 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:24.881030 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:24.881770 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:24.881776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:24.881896 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:24.881952 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:24.882303 (+ 351us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:24.882326 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 18:56:24.882392 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 18:56:24.882520 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1964,"thread_start_us":1813,"threads_started":1}
I20260809 18:56:24.921531 19763 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:24.921866 19763 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:24.925963 19763 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: Sending DeleteTablet for 3 replicas of tablet 4972ba9d1665416c99e6ba8eeb6a0130
I20260809 18:56:24.927016 19962 tablet_service.cc:1514] Processing DeleteTablet for tablet 4972ba9d1665416c99e6ba8eeb6a0130 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:24 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:32858
I20260809 18:56:24.927407 20355 tablet_service.cc:1514] Processing DeleteTablet for tablet 4972ba9d1665416c99e6ba8eeb6a0130 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:24 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:35820
I20260809 18:56:24.928488 20158 tablet_service.cc:1514] Processing DeleteTablet for tablet 4972ba9d1665416c99e6ba8eeb6a0130 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:24 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:39590
I20260809 18:56:24.933277 19763 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57408:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:24.933916 19763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:24.945571 20156 tablet_service.cc:1467] Processing CreateTablet for tablet abbb760bb2284b89999ec1ef88a341c4 (DEFAULT_TABLE table=test-table [id=8ba71c4e9be3490dacc9c975146b396c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:24.945966 19960 tablet_service.cc:1467] Processing CreateTablet for tablet abbb760bb2284b89999ec1ef88a341c4 (DEFAULT_TABLE table=test-table [id=8ba71c4e9be3490dacc9c975146b396c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:24.946209 20156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbb760bb2284b89999ec1ef88a341c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.946478 19960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbb760bb2284b89999ec1ef88a341c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.949777 20354 tablet_service.cc:1467] Processing CreateTablet for tablet abbb760bb2284b89999ec1ef88a341c4 (DEFAULT_TABLE table=test-table [id=8ba71c4e9be3490dacc9c975146b396c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:24.950199 20354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbb760bb2284b89999ec1ef88a341c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:24.953011 20473 tablet_bootstrap.cc:492] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: Bootstrap starting.
I20260809 18:56:24.954766 20473 tablet_bootstrap.cc:654] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.960458 20474 tablet_bootstrap.cc:492] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: Bootstrap starting.
I20260809 18:56:24.962129 20474 tablet_bootstrap.cc:654] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.970561 20473 tablet_bootstrap.cc:492] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: No bootstrap required, opened a new log
I20260809 18:56:24.970764 20473 ts_tablet_manager.cc:1397] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.006s
I20260809 18:56:24.971698 20473 raft_consensus.cc:348] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.971971 20473 raft_consensus.cc:374] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.972078 20473 raft_consensus.cc:729] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb7f462ac70426dbac86067df931acc, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.972393 20473 consensus_queue.cc:260] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.973037 20473 ts_tablet_manager.cc:1428] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 18:56:24.976629 20472 tablet_bootstrap.cc:492] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: Bootstrap starting.
I20260809 18:56:24.978564 20472 tablet_bootstrap.cc:654] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:24.995433 20474 tablet_bootstrap.cc:492] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: No bootstrap required, opened a new log
I20260809 18:56:24.995638 20474 ts_tablet_manager.cc:1397] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.011s
I20260809 18:56:24.996515 20474 raft_consensus.cc:348] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.996799 20474 raft_consensus.cc:374] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.996893 20474 raft_consensus.cc:729] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f7e09370042f6a92e16a6f4e463f4, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.997176 20474 consensus_queue.cc:260] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.997895 20472 tablet_bootstrap.cc:492] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: No bootstrap required, opened a new log
I20260809 18:56:24.998085 20472 ts_tablet_manager.cc:1397] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.004s
I20260809 18:56:24.998845 20559 tablet_replica.cc:330] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: stopping tablet replica
I20260809 18:56:24.998845 20472 raft_consensus.cc:348] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:24.999085 20472 raft_consensus.cc:374] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:24.999164 20472 raft_consensus.cc:729] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d2a8ec067f47e5b334f3352ee8b967, State: Initialized, Role: FOLLOWER
I20260809 18:56:24.999372 20559 raft_consensus.cc:2229] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:24.999449 20472 consensus_queue.cc:260] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:25.000913 20472 ts_tablet_manager.cc:1428] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:25.002619 20555 tablet_replica.cc:330] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: stopping tablet replica
I20260809 18:56:25.003054 20555 raft_consensus.cc:2229] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:25.003688 20555 raft_consensus.cc:2258] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:25.003979 20559 raft_consensus.cc:2258] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:25.004673 20557 tablet_replica.cc:330] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: stopping tablet replica
I20260809 18:56:25.005079 20557 raft_consensus.cc:2229] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:25.007866 20474 ts_tablet_manager.cc:1428] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260809 18:56:25.008237 20557 raft_consensus.cc:2258] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:25.010993 20559 ts_tablet_manager.cc:1905] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:25.018949 20555 ts_tablet_manager.cc:1905] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:25.019001 20559 ts_tablet_manager.cc:1918] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:25.019169 20559 log.cc:1196] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/4972ba9d1665416c99e6ba8eeb6a0130
I20260809 18:56:25.021958 20557 ts_tablet_manager.cc:1905] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:25.025655 20555 ts_tablet_manager.cc:1918] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:25.025838 20555 log.cc:1196] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/4972ba9d1665416c99e6ba8eeb6a0130
I20260809 18:56:25.026290 20555 ts_tablet_manager.cc:1939] T 4972ba9d1665416c99e6ba8eeb6a0130 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting consensus metadata
I20260809 18:56:25.027848 19746 catalog_manager.cc:4841] TS 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225): tablet 4972ba9d1665416c99e6ba8eeb6a0130 (table test-table [id=a04ec19357a24f27b87ff96a95d00346]) successfully deleted
I20260809 18:56:25.028993 20557 ts_tablet_manager.cc:1918] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:25.029184 20557 log.cc:1196] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/4972ba9d1665416c99e6ba8eeb6a0130
I20260809 18:56:25.029716 20557 ts_tablet_manager.cc:1939] T 4972ba9d1665416c99e6ba8eeb6a0130 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting consensus metadata
I20260809 18:56:25.029770 20559 ts_tablet_manager.cc:1939] T 4972ba9d1665416c99e6ba8eeb6a0130 P deb7f462ac70426dbac86067df931acc: Deleting consensus metadata
I20260809 18:56:25.031463 19746 catalog_manager.cc:4841] TS ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267): tablet 4972ba9d1665416c99e6ba8eeb6a0130 (table test-table [id=a04ec19357a24f27b87ff96a95d00346]) successfully deleted
I20260809 18:56:25.031719 19745 catalog_manager.cc:4841] TS deb7f462ac70426dbac86067df931acc (127.16.188.194:33947): tablet 4972ba9d1665416c99e6ba8eeb6a0130 (table test-table [id=a04ec19357a24f27b87ff96a95d00346]) successfully deleted
I20260809 18:56:25.072678 20483 raft_consensus.cc:482] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:25.072911 20483 raft_consensus.cc:504] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:25.074805 20483 leader_election.cc:288] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225), deb7f462ac70426dbac86067df931acc (127.16.188.194:33947)
I20260809 18:56:25.094362 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.075661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:45815 (local address 127.16.188.193:35225)
0809 18:56:25.075874 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:25.075880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:25.086079 (+ 10199us) server_negotiation.cc:407] Connection header received
0809 18:56:25.086977 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:25.086982 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:25.087064 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:25.087150 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:25.088185 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.089338 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.091860 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.093137 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.093303 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.093380 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:25.093902 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 18:56:25.094040 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 18:56:25.095527 20566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.075148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:35225 (local address 127.16.188.195:45815)
0809 18:56:25.085945 (+ 10797us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:25.085969 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:25.086781 (+ 812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:25.087353 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:25.087358 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:25.087414 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:25.087947 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:25.087962 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.089528 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.089533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:25.091661 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:25.091679 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.093525 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.093531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:25.093703 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.093738 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:56:25.094934 (+ 1196us) client_negotiation.cc:240] Negotiation successful
0809 18:56:25.095075 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10636,"mutex_wait_us":35,"spinlock_wait_cycles":8576,"thread_start_us":10960,"threads_started":1}
I20260809 18:56:25.096134 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.075753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:34667 (local address 127.16.188.194:33947)
0809 18:56:25.075963 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:25.075970 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:25.086444 (+ 10474us) server_negotiation.cc:407] Connection header received
0809 18:56:25.087012 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:25.087018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:25.087095 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:25.087157 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:25.088022 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.089204 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.092043 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.093444 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.093585 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.093655 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:25.095686 (+ 2031us) server_negotiation.cc:299] Negotiation successful
0809 18:56:25.095840 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 18:56:25.096432 19993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbb760bb2284b89999ec1ef88a341c4" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d2a8ec067f47e5b334f3352ee8b967" is_pre_election: true
I20260809 18:56:25.096740 19993 raft_consensus.cc:2454] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 0.
I20260809 18:56:25.096909 20564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.075353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:33947 (local address 127.16.188.195:34667)
0809 18:56:25.086334 (+ 10981us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:25.086353 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:25.086833 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:25.087350 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:25.087355 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:25.087389 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:25.087822 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:25.087838 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.089380 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.089385 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:25.091853 (+ 2468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:25.091868 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.095300 (+ 3432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.095306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:25.095508 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.095543 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:56:25.096392 (+ 849us) client_negotiation.cc:240] Negotiation successful
0809 18:56:25.096528 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10855,"mutex_wait_us":2,"spinlock_wait_cycles":620160,"thread_start_us":10287,"threads_started":1}
I20260809 18:56:25.097586 20194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbb760bb2284b89999ec1ef88a341c4" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb7f462ac70426dbac86067df931acc" is_pre_election: true
I20260809 18:56:25.097672 20290 leader_election.cc:302] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, ef0f7e09370042f6a92e16a6f4e463f4; no voters:
I20260809 18:56:25.097846 20194 raft_consensus.cc:2454] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 0.
I20260809 18:56:25.098166 20483 raft_consensus.cc:2781] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:25.098290 20483 raft_consensus.cc:482] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:25.098397 20483 raft_consensus.cc:3037] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:25.101624 20483 raft_consensus.cc:504] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:25.102350 20483 leader_election.cc:288] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 election: Requested vote from peers 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225), deb7f462ac70426dbac86067df931acc (127.16.188.194:33947)
I20260809 18:56:25.103294 19993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbb760bb2284b89999ec1ef88a341c4" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d2a8ec067f47e5b334f3352ee8b967"
I20260809 18:56:25.103518 19993 raft_consensus.cc:3037] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:25.105672 20194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbb760bb2284b89999ec1ef88a341c4" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb7f462ac70426dbac86067df931acc"
I20260809 18:56:25.105913 20194 raft_consensus.cc:3037] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:25.106688 19993 raft_consensus.cc:2454] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 1.
I20260809 18:56:25.107118 20290 leader_election.cc:302] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, ef0f7e09370042f6a92e16a6f4e463f4; no voters:
I20260809 18:56:25.107419 20483 raft_consensus.cc:2781] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:25.109022 20194 raft_consensus.cc:2454] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 1.
I20260809 18:56:25.109912 20483 raft_consensus.cc:686] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f7e09370042f6a92e16a6f4e463f4, State: Running, Role: LEADER
I20260809 18:56:25.110351 20483 consensus_queue.cc:237] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:25.114491 19765 catalog_manager.cc:5495] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260809 18:56:25.147679 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.140530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35836 (local address 127.16.188.195:35267)
0809 18:56:25.140828 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:25.140834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:25.140854 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:56:25.140969 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:25.140974 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:25.141121 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:25.141294 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:25.141696 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.142821 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.144703 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.145425 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.145556 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.146083 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:25.146855 (+ 772us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:25.147007 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:25.147115 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 18:56:25.147204 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260809 18:56:25.166692 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.159906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:60513 (local address 127.16.188.194:33947)
0809 18:56:25.160080 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:25.160086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:25.160280 (+ 194us) server_negotiation.cc:407] Connection header received
0809 18:56:25.160554 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:25.160560 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:25.160650 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:25.160756 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:25.161358 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.162526 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.164509 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.165253 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.165380 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.165907 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:25.166073 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:25.166161 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:25.166324 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 18:56:25.166408 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 18:56:25.166808 20573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.159550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:33947 (local address 127.16.188.195:60513)
0809 18:56:25.160176 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:25.160200 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:25.160400 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:25.160776 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:25.160782 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:25.160794 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:25.161192 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:25.161205 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.162676 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.162682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:25.164354 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:25.164371 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.165448 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.165455 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:25.165639 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.165720 (+ 81us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:25.166184 (+ 464us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:25.166197 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:56:25.166287 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 18:56:25.166423 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":544,"threads_started":1}
I20260809 18:56:25.178259 20194 raft_consensus.cc:1261] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Refusing update from remote peer ef0f7e09370042f6a92e16a6f4e463f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:25.178903 19993 raft_consensus.cc:1261] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Refusing update from remote peer ef0f7e09370042f6a92e16a6f4e463f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:25.179225 20567 consensus_queue.cc:1035] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:25.179625 20483 consensus_queue.cc:1035] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:25.197266 20526 mvcc.cc:205] Tried to move back new op lower bound from 7316692112083791872 to 7316692111817105408. Current Snapshot: MvccSnapshot[applied={T|T < 7316692112083791872}]
I20260809 18:56:25.231804 20548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.223242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:35267 (local address 127.16.188.194:56507)
0809 18:56:25.223522 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:25.223548 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:25.223664 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:25.224174 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:25.224179 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:25.224193 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:56:25.224552 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:25.224569 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.226313 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.226319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:25.228786 (+ 2467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:25.228803 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.230136 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.230142 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:25.230436 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.230488 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:56:25.231016 (+ 528us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:56:25.231029 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:56:25.231118 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:56:25.231273 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140}
I20260809 18:56:25.233721 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:25.223432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:56507 (local address 127.16.188.195:35267)
0809 18:56:25.223603 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:25.223609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:25.223630 (+ 21us) server_negotiation.cc:407] Connection header received
0809 18:56:25.223801 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:25.223806 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:25.223896 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:25.223991 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:25.224739 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.226007 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.229063 (+ 3056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:25.229868 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:25.229996 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:25.230707 (+ 711us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:25.230882 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:25.230964 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:25.232209 (+ 1245us) server_negotiation.cc:299] Negotiation successful
0809 18:56:25.233257 (+ 1048us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 18:56:25.235584 20526 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 18:56:26.857244 19765 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:26.857477 19765 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:26.862526 19765 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: Sending DeleteTablet for 3 replicas of tablet abbb760bb2284b89999ec1ef88a341c4
I20260809 18:56:26.863499 19962 tablet_service.cc:1514] Processing DeleteTablet for tablet abbb760bb2284b89999ec1ef88a341c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:26 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:32858
I20260809 18:56:26.863489 20158 tablet_service.cc:1514] Processing DeleteTablet for tablet abbb760bb2284b89999ec1ef88a341c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:26 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:39590
I20260809 18:56:26.863492 20355 tablet_service.cc:1514] Processing DeleteTablet for tablet abbb760bb2284b89999ec1ef88a341c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:26 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:35820
I20260809 18:56:26.874902 20608 tablet_replica.cc:330] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: stopping tablet replica
I20260809 18:56:26.875303 20608 raft_consensus.cc:2229] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:26.876436 20608 raft_consensus.cc:2258] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:26.877267 20606 tablet_replica.cc:330] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: stopping tablet replica
I20260809 18:56:26.877602 20606 raft_consensus.cc:2229] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:26.877975 20606 raft_consensus.cc:2258] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:26.878983 20607 tablet_replica.cc:330] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: stopping tablet replica
I20260809 18:56:26.879101 20606 ts_tablet_manager.cc:1905] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:26.879145 20608 ts_tablet_manager.cc:1905] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:26.879256 20607 raft_consensus.cc:2229] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:26.879925 20607 raft_consensus.cc:2258] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:26.880914 20607 ts_tablet_manager.cc:1905] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:26.886870 20606 ts_tablet_manager.cc:1918] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:26.887151 20606 log.cc:1196] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/abbb760bb2284b89999ec1ef88a341c4
I20260809 18:56:26.887899 20606 ts_tablet_manager.cc:1939] T abbb760bb2284b89999ec1ef88a341c4 P deb7f462ac70426dbac86067df931acc: Deleting consensus metadata
I20260809 18:56:26.887954 20608 ts_tablet_manager.cc:1918] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:26.888209 20608 log.cc:1196] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/abbb760bb2284b89999ec1ef88a341c4
I20260809 18:56:26.888859 20608 ts_tablet_manager.cc:1939] T abbb760bb2284b89999ec1ef88a341c4 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting consensus metadata
I20260809 18:56:26.889047 19745 catalog_manager.cc:4841] TS deb7f462ac70426dbac86067df931acc (127.16.188.194:33947): tablet abbb760bb2284b89999ec1ef88a341c4 (table test-table [id=8ba71c4e9be3490dacc9c975146b396c]) successfully deleted
I20260809 18:56:26.889487 20607 ts_tablet_manager.cc:1918] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:26.889614 20607 log.cc:1196] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/abbb760bb2284b89999ec1ef88a341c4
I20260809 18:56:26.890043 20607 ts_tablet_manager.cc:1939] T abbb760bb2284b89999ec1ef88a341c4 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting consensus metadata
I20260809 18:56:26.890151 19746 catalog_manager.cc:4841] TS 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225): tablet abbb760bb2284b89999ec1ef88a341c4 (table test-table [id=8ba71c4e9be3490dacc9c975146b396c]) successfully deleted
I20260809 18:56:26.891084 19746 catalog_manager.cc:4841] TS ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267): tablet abbb760bb2284b89999ec1ef88a341c4 (table test-table [id=8ba71c4e9be3490dacc9c975146b396c]) successfully deleted
Aug 09 18:56:26 dist-test-slave-266d krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301786, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:56:26 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301786, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:26.934212 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:26.917869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57432 (local address 127.16.188.254:35845)
0809 18:56:26.918555 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:26.918560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:26.918590 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:56:26.918735 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:26.918739 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:26.918820 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:26.918908 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:26.920220 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:26.921557 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:26.922853 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:26.923350 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:26.923452 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:26.927743 (+ 4291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:26.927748 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:26.927752 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:26.927797 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:26.931479 (+ 3682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:26.932244 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:26.932248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:26.932251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:26.932411 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:26.932801 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:26.932805 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:26.932808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:26.933178 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:26.933430 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:26.933633 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 18:56:26.933826 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":342,"threads_started":1}
I20260809 18:56:26.937819 19765 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57432:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:26.938567 19765 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:26.945235 19962 tablet_service.cc:1467] Processing CreateTablet for tablet 06697b38c37048e0a8c5130941645397 (DEFAULT_TABLE table=test-table [id=42d47d3d787d4580a91b66e937cc0d86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:26.945508 20158 tablet_service.cc:1467] Processing CreateTablet for tablet 06697b38c37048e0a8c5130941645397 (DEFAULT_TABLE table=test-table [id=42d47d3d787d4580a91b66e937cc0d86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:26.945501 20355 tablet_service.cc:1467] Processing CreateTablet for tablet 06697b38c37048e0a8c5130941645397 (DEFAULT_TABLE table=test-table [id=42d47d3d787d4580a91b66e937cc0d86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:26.945749 19962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06697b38c37048e0a8c5130941645397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:26.945973 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06697b38c37048e0a8c5130941645397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:26.945984 20158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06697b38c37048e0a8c5130941645397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:26.953469 20623 tablet_bootstrap.cc:492] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: Bootstrap starting.
I20260809 18:56:26.955821 20623 tablet_bootstrap.cc:654] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:26.957574 20624 tablet_bootstrap.cc:492] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: Bootstrap starting.
I20260809 18:56:26.959758 20623 tablet_bootstrap.cc:492] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: No bootstrap required, opened a new log
I20260809 18:56:26.959918 20623 ts_tablet_manager.cc:1397] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 18:56:26.960345 20624 tablet_bootstrap.cc:654] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:26.961136 20625 tablet_bootstrap.cc:492] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: Bootstrap starting.
I20260809 18:56:26.961125 20623 raft_consensus.cc:348] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:26.961491 20623 raft_consensus.cc:374] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:26.961659 20623 raft_consensus.cc:729] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d2a8ec067f47e5b334f3352ee8b967, State: Initialized, Role: FOLLOWER
I20260809 18:56:26.961951 20623 consensus_queue.cc:260] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:26.963641 20623 ts_tablet_manager.cc:1428] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260809 18:56:26.964042 20624 tablet_bootstrap.cc:492] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: No bootstrap required, opened a new log
I20260809 18:56:26.964237 20625 tablet_bootstrap.cc:654] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:26.964249 20624 ts_tablet_manager.cc:1397] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260809 18:56:26.965330 20624 raft_consensus.cc:348] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:26.965673 20624 raft_consensus.cc:374] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:26.965896 20624 raft_consensus.cc:729] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb7f462ac70426dbac86067df931acc, State: Initialized, Role: FOLLOWER
I20260809 18:56:26.966193 20624 consensus_queue.cc:260] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:26.967820 20624 ts_tablet_manager.cc:1428] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:26.969312 20625 tablet_bootstrap.cc:492] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: No bootstrap required, opened a new log
I20260809 18:56:26.969512 20625 ts_tablet_manager.cc:1397] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 18:56:26.970549 20625 raft_consensus.cc:348] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:26.970858 20625 raft_consensus.cc:374] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:26.971036 20625 raft_consensus.cc:729] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f7e09370042f6a92e16a6f4e463f4, State: Initialized, Role: FOLLOWER
I20260809 18:56:26.971302 20625 consensus_queue.cc:260] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:26.971882 20625 ts_tablet_manager.cc:1428] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 18:56:27.070783 20596 raft_consensus.cc:482] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:27.071094 20596 raft_consensus.cc:504] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.072041 20596 leader_election.cc:288] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225), deb7f462ac70426dbac86067df931acc (127.16.188.194:33947)
I20260809 18:56:27.072705 19993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06697b38c37048e0a8c5130941645397" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d2a8ec067f47e5b334f3352ee8b967" is_pre_election: true
I20260809 18:56:27.072690 20192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06697b38c37048e0a8c5130941645397" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb7f462ac70426dbac86067df931acc" is_pre_election: true
I20260809 18:56:27.073035 19993 raft_consensus.cc:2454] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 0.
I20260809 18:56:27.073031 20192 raft_consensus.cc:2454] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 0.
I20260809 18:56:27.073685 20290 leader_election.cc:302] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, deb7f462ac70426dbac86067df931acc, ef0f7e09370042f6a92e16a6f4e463f4; no voters:
I20260809 18:56:27.074075 20596 raft_consensus.cc:2781] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:27.074306 20596 raft_consensus.cc:482] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:27.074458 20596 raft_consensus.cc:3037] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:27.077382 20596 raft_consensus.cc:504] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.077950 20596 leader_election.cc:288] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 election: Requested vote from peers 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225), deb7f462ac70426dbac86067df931acc (127.16.188.194:33947)
I20260809 18:56:27.078500 19993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06697b38c37048e0a8c5130941645397" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d2a8ec067f47e5b334f3352ee8b967"
I20260809 18:56:27.078564 20192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06697b38c37048e0a8c5130941645397" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb7f462ac70426dbac86067df931acc"
I20260809 18:56:27.078784 19993 raft_consensus.cc:3037] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:27.078899 20192 raft_consensus.cc:3037] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:27.081575 19993 raft_consensus.cc:2454] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 1.
I20260809 18:56:27.081872 20192 raft_consensus.cc:2454] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 1.
I20260809 18:56:27.082062 20290 leader_election.cc:302] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, ef0f7e09370042f6a92e16a6f4e463f4; no voters:
I20260809 18:56:27.082430 20596 raft_consensus.cc:2781] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:27.082594 20596 raft_consensus.cc:686] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f7e09370042f6a92e16a6f4e463f4, State: Running, Role: LEADER
I20260809 18:56:27.082942 20596 consensus_queue.cc:237] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.086179 19765 catalog_manager.cc:5495] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260809 18:56:27.120465 20637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:27.113413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35848 (local address 127.16.188.195:35267)
0809 18:56:27.114377 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:27.114381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:27.114401 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:56:27.114452 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:27.114457 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:27.114528 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:27.114614 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:27.115031 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:27.116255 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:27.117938 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:27.118729 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:27.118851 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:27.119525 (+ 674us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:27.119674 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:27.119742 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:27.119835 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 18:56:27.119895 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":541,"threads_started":1}
I20260809 18:56:27.130349 20192 raft_consensus.cc:1261] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Refusing update from remote peer ef0f7e09370042f6a92e16a6f4e463f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:27.130330 19993 raft_consensus.cc:1261] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Refusing update from remote peer ef0f7e09370042f6a92e16a6f4e463f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:27.131021 20483 consensus_queue.cc:1035] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:27.131313 20596 consensus_queue.cc:1035] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:27.180066 19763 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:27.180361 19763 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:27.183534 19763 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: Sending DeleteTablet for 3 replicas of tablet 06697b38c37048e0a8c5130941645397
I20260809 18:56:27.184607 19962 tablet_service.cc:1514] Processing DeleteTablet for tablet 06697b38c37048e0a8c5130941645397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:27 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:32858
I20260809 18:56:27.184634 20158 tablet_service.cc:1514] Processing DeleteTablet for tablet 06697b38c37048e0a8c5130941645397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:27 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:39590
I20260809 18:56:27.184846 20355 tablet_service.cc:1514] Processing DeleteTablet for tablet 06697b38c37048e0a8c5130941645397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:27 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:35820
I20260809 18:56:27.184985 20608 tablet_replica.cc:330] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: stopping tablet replica
I20260809 18:56:27.185114 20606 tablet_replica.cc:330] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: stopping tablet replica
I20260809 18:56:27.185269 20607 tablet_replica.cc:330] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: stopping tablet replica
I20260809 18:56:27.185345 20608 raft_consensus.cc:2229] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:27.185420 20606 raft_consensus.cc:2229] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:27.185568 20607 raft_consensus.cc:2229] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:27.185614 20608 raft_consensus.cc:2258] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:27.185667 20606 raft_consensus.cc:2258] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:27.185551 19763 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57432:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 18:56:27.185930 20607 raft_consensus.cc:2258] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 18:56:27.186290 19763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:27.186823 20608 ts_tablet_manager.cc:1905] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:27.187048 20606 ts_tablet_manager.cc:1905] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:27.187083 20607 ts_tablet_manager.cc:1905] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:27.194094 20158 tablet_service.cc:1467] Processing CreateTablet for tablet 4d738482203449649e24b3c50e1797f6 (DEFAULT_TABLE table=test-table [id=1aff2caaee7c4db0b9f06ce46e932386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:27.194638 20158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d738482203449649e24b3c50e1797f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:27.194837 19962 tablet_service.cc:1467] Processing CreateTablet for tablet 4d738482203449649e24b3c50e1797f6 (DEFAULT_TABLE table=test-table [id=1aff2caaee7c4db0b9f06ce46e932386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:27.194890 20608 ts_tablet_manager.cc:1918] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:27.194979 20355 tablet_service.cc:1467] Processing CreateTablet for tablet 4d738482203449649e24b3c50e1797f6 (DEFAULT_TABLE table=test-table [id=1aff2caaee7c4db0b9f06ce46e932386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:27.195075 20608 log.cc:1196] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/06697b38c37048e0a8c5130941645397
I20260809 18:56:27.195252 19962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d738482203449649e24b3c50e1797f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:27.195510 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d738482203449649e24b3c50e1797f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:27.195703 20608 ts_tablet_manager.cc:1939] T 06697b38c37048e0a8c5130941645397 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting consensus metadata
I20260809 18:56:27.196893 19746 catalog_manager.cc:4841] TS 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225): tablet 06697b38c37048e0a8c5130941645397 (table test-table [id=42d47d3d787d4580a91b66e937cc0d86]) successfully deleted
I20260809 18:56:27.198194 20607 ts_tablet_manager.cc:1918] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:27.198448 20607 log.cc:1196] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/06697b38c37048e0a8c5130941645397
I20260809 18:56:27.199045 20607 ts_tablet_manager.cc:1939] T 06697b38c37048e0a8c5130941645397 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting consensus metadata
I20260809 18:56:27.200162 19746 catalog_manager.cc:4841] TS ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267): tablet 06697b38c37048e0a8c5130941645397 (table test-table [id=42d47d3d787d4580a91b66e937cc0d86]) successfully deleted
I20260809 18:56:27.201068 20606 ts_tablet_manager.cc:1918] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:56:27.201347 20606 log.cc:1196] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/06697b38c37048e0a8c5130941645397
I20260809 18:56:27.201984 20606 ts_tablet_manager.cc:1939] T 06697b38c37048e0a8c5130941645397 P deb7f462ac70426dbac86067df931acc: Deleting consensus metadata
I20260809 18:56:27.202754 20624 tablet_bootstrap.cc:492] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: Bootstrap starting.
I20260809 18:56:27.203953 19745 catalog_manager.cc:4841] TS deb7f462ac70426dbac86067df931acc (127.16.188.194:33947): tablet 06697b38c37048e0a8c5130941645397 (table test-table [id=42d47d3d787d4580a91b66e937cc0d86]) successfully deleted
I20260809 18:56:27.204313 20625 tablet_bootstrap.cc:492] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: Bootstrap starting.
I20260809 18:56:27.205660 20624 tablet_bootstrap.cc:654] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:27.205684 20623 tablet_bootstrap.cc:492] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: Bootstrap starting.
I20260809 18:56:27.207088 20625 tablet_bootstrap.cc:654] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:27.208304 20623 tablet_bootstrap.cc:654] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:27.209635 20624 tablet_bootstrap.cc:492] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: No bootstrap required, opened a new log
I20260809 18:56:27.209911 20624 ts_tablet_manager.cc:1397] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20260809 18:56:27.211197 20624 raft_consensus.cc:348] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.211580 20625 tablet_bootstrap.cc:492] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: No bootstrap required, opened a new log
I20260809 18:56:27.211548 20624 raft_consensus.cc:374] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:27.211774 20625 ts_tablet_manager.cc:1397] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260809 18:56:27.211892 20624 raft_consensus.cc:729] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb7f462ac70426dbac86067df931acc, State: Initialized, Role: FOLLOWER
I20260809 18:56:27.212210 20624 consensus_queue.cc:260] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.212798 20624 ts_tablet_manager.cc:1428] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 18:56:27.212944 20625 raft_consensus.cc:348] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.213318 20625 raft_consensus.cc:374] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:27.213470 20625 raft_consensus.cc:729] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f7e09370042f6a92e16a6f4e463f4, State: Initialized, Role: FOLLOWER
I20260809 18:56:27.213749 20623 tablet_bootstrap.cc:492] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: No bootstrap required, opened a new log
I20260809 18:56:27.213871 20623 ts_tablet_manager.cc:1397] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 18:56:27.213811 20625 consensus_queue.cc:260] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.214478 20625 ts_tablet_manager.cc:1428] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:27.214906 20623 raft_consensus.cc:348] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.215193 20623 raft_consensus.cc:374] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:27.215299 20623 raft_consensus.cc:729] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d2a8ec067f47e5b334f3352ee8b967, State: Initialized, Role: FOLLOWER
I20260809 18:56:27.215701 20623 consensus_queue.cc:260] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.216321 20623 ts_tablet_manager.cc:1428] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:56:27.295567 20643 raft_consensus.cc:482] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:27.295840 20643 raft_consensus.cc:504] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.296903 20643 leader_election.cc:288] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225), deb7f462ac70426dbac86067df931acc (127.16.188.194:33947)
I20260809 18:56:27.297456 19993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d738482203449649e24b3c50e1797f6" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d2a8ec067f47e5b334f3352ee8b967" is_pre_election: true
I20260809 18:56:27.297524 20192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d738482203449649e24b3c50e1797f6" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb7f462ac70426dbac86067df931acc" is_pre_election: true
I20260809 18:56:27.297824 19993 raft_consensus.cc:2454] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 0.
I20260809 18:56:27.297829 20192 raft_consensus.cc:2454] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 0.
I20260809 18:56:27.298382 20290 leader_election.cc:302] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, deb7f462ac70426dbac86067df931acc, ef0f7e09370042f6a92e16a6f4e463f4; no voters:
I20260809 18:56:27.298730 20643 raft_consensus.cc:2781] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:27.298928 20643 raft_consensus.cc:482] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:27.299036 20643 raft_consensus.cc:3037] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:27.302019 20643 raft_consensus.cc:504] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.302628 20643 leader_election.cc:288] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 election: Requested vote from peers 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225), deb7f462ac70426dbac86067df931acc (127.16.188.194:33947)
I20260809 18:56:27.303104 19993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d738482203449649e24b3c50e1797f6" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d2a8ec067f47e5b334f3352ee8b967"
I20260809 18:56:27.303174 20192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d738482203449649e24b3c50e1797f6" candidate_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb7f462ac70426dbac86067df931acc"
I20260809 18:56:27.303337 19993 raft_consensus.cc:3037] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:27.303447 20192 raft_consensus.cc:3037] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:27.306569 19993 raft_consensus.cc:2454] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 1.
I20260809 18:56:27.306573 20192 raft_consensus.cc:2454] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f7e09370042f6a92e16a6f4e463f4 in term 1.
I20260809 18:56:27.307003 20290 leader_election.cc:302] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d2a8ec067f47e5b334f3352ee8b967, ef0f7e09370042f6a92e16a6f4e463f4; no voters:
I20260809 18:56:27.307329 20643 raft_consensus.cc:2781] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:27.307514 20643 raft_consensus.cc:686] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f7e09370042f6a92e16a6f4e463f4, State: Running, Role: LEADER
I20260809 18:56:27.307890 20643 consensus_queue.cc:237] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } }
I20260809 18:56:27.310889 19765 catalog_manager.cc:5495] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f7e09370042f6a92e16a6f4e463f4" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260809 18:56:27.348171 20192 raft_consensus.cc:1261] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Refusing update from remote peer ef0f7e09370042f6a92e16a6f4e463f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:27.348776 19993 raft_consensus.cc:1261] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Refusing update from remote peer ef0f7e09370042f6a92e16a6f4e463f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:27.348793 20643 consensus_queue.cc:1035] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb7f462ac70426dbac86067df931acc" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:27.349444 20596 consensus_queue.cc:1035] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d2a8ec067f47e5b334f3352ee8b967" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 18:56:27.369220 20584 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 18:56:28.965116 19764 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:28.965478 19764 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:28.970965 19764 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e27b930fdf984c689866ba4a9b28efe4: Sending DeleteTablet for 3 replicas of tablet 4d738482203449649e24b3c50e1797f6
I20260809 18:56:28.971818 19962 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d738482203449649e24b3c50e1797f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:28 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:32858
I20260809 18:56:28.971971 20158 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d738482203449649e24b3c50e1797f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:28 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:39590
I20260809 18:56:28.971990 20355 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d738482203449649e24b3c50e1797f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:28 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:35820
I20260809 18:56:28.972667 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19869
I20260809 18:56:28.975340 20677 tablet_replica.cc:330] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: stopping tablet replica
I20260809 18:56:28.975554 20677 raft_consensus.cc:2229] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:28.975905 20677 raft_consensus.cc:2258] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:28.976933 20677 ts_tablet_manager.cc:1905] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:28.984871 20678 tablet_replica.cc:330] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: stopping tablet replica
I20260809 18:56:28.985311 20677 ts_tablet_manager.cc:1918] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:28.985358 20678 raft_consensus.cc:2229] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:28.985512 20677 log.cc:1196] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/4d738482203449649e24b3c50e1797f6
I20260809 18:56:28.985847 20678 raft_consensus.cc:2258] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:28.986615 20677 ts_tablet_manager.cc:1939] T 4d738482203449649e24b3c50e1797f6 P ef0f7e09370042f6a92e16a6f4e463f4: Deleting consensus metadata
I20260809 18:56:28.987414 20675 tablet_replica.cc:330] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: stopping tablet replica
I20260809 18:56:28.987401 20678 ts_tablet_manager.cc:1905] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:28.987675 20675 raft_consensus.cc:2229] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:28.987740 19746 catalog_manager.cc:4841] TS ef0f7e09370042f6a92e16a6f4e463f4 (127.16.188.195:35267): tablet 4d738482203449649e24b3c50e1797f6 (table test-table [id=1aff2caaee7c4db0b9f06ce46e932386]) successfully deleted
I20260809 18:56:28.988124 20675 raft_consensus.cc:2258] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:28.989037 20675 ts_tablet_manager.cc:1905] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:28.995285 20678 ts_tablet_manager.cc:1918] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:28.995447 20678 log.cc:1196] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/4d738482203449649e24b3c50e1797f6
I20260809 18:56:28.996235 20678 ts_tablet_manager.cc:1939] T 4d738482203449649e24b3c50e1797f6 P deb7f462ac70426dbac86067df931acc: Deleting consensus metadata
I20260809 18:56:28.997468 19745 catalog_manager.cc:4841] TS deb7f462ac70426dbac86067df931acc (127.16.188.194:33947): tablet 4d738482203449649e24b3c50e1797f6 (table test-table [id=1aff2caaee7c4db0b9f06ce46e932386]) successfully deleted
I20260809 18:56:28.997936 20675 ts_tablet_manager.cc:1918] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:56:28.998152 20675 log.cc:1196] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/4d738482203449649e24b3c50e1797f6
I20260809 18:56:28.998678 20675 ts_tablet_manager.cc:1939] T 4d738482203449649e24b3c50e1797f6 P 67d2a8ec067f47e5b334f3352ee8b967: Deleting consensus metadata
I20260809 18:56:28.999631 19746 catalog_manager.cc:4841] TS 67d2a8ec067f47e5b334f3352ee8b967 (127.16.188.193:35225): tablet 4d738482203449649e24b3c50e1797f6 (table test-table [id=1aff2caaee7c4db0b9f06ce46e932386]) successfully deleted
Aug 09 18:56:28 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301786, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:29.008307 20682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:28.974104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32884 (local address 127.16.188.193:35225)
0809 18:56:28.974951 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:28.974958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:28.984552 (+ 9594us) server_negotiation.cc:407] Connection header received
0809 18:56:28.985021 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:28.985027 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:28.985142 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:28.985230 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:28.988100 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:28.989361 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:28.990684 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:28.991349 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:28.991465 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.001073 (+ 9608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.001209 (+ 136us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.001233 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.001284 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.005265 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.006001 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.006008 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.006011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.006266 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.006638 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.006641 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.006643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.007155 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.007442 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.007664 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.007842 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":515,"threads_started":1}
W20260809 18:56:29.009146 20059 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32884
W20260809 18:56:29.009841 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19869: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:29.010076 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19869
I20260809 18:56:29.041738 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20072
Aug 09 18:56:29 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301786, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:56:29.056093 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.042513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39610 (local address 127.16.188.194:33947)
0809 18:56:29.043014 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:29.043019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:29.043036 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:56:29.043090 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:29.043094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:29.043153 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:29.043242 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:29.044824 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.045614 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.046817 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.047255 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.047351 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.051262 (+ 3911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.051274 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.051288 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.051328 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.053906 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.054465 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.054472 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.054474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.054637 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.054902 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.054905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.054907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.055240 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.055464 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.055672 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.055828 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":262,"threads_started":1}
W20260809 18:56:29.056923 20251 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39610
W20260809 18:56:29.057626 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20072: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:29.057783 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20072
I20260809 18:56:29.085210 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20267
Aug 09 18:56:29 dist-test-slave-266d krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301786, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:56:29.099603 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:29.085915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35864 (local address 127.16.188.195:35267)
0809 18:56:29.086455 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:29.086459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:29.086475 (+ 16us) server_negotiation.cc:407] Connection header received
0809 18:56:29.086529 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:29.086533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:29.086600 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:29.086692 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:29.087921 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.088793 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.090039 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:29.090450 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:29.090540 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:29.094430 (+ 3890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:29.094445 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:29.094462 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:29.094494 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:29.097357 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.097890 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.097897 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.097899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.098023 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:29.098311 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:29.098314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:29.098316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:29.098672 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:29.098901 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:29.099076 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 18:56:29.099242 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":292,"threads_started":1}
W20260809 18:56:29.100333 20442 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35864
W20260809 18:56:29.100988 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20267: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:29.101146 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20267
I20260809 18:56:29.128585 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19718
I20260809 18:56:29.129776 19822 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:29.246897 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19718
2026-08-09T18:56:29Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8244 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:29 dist-test-slave-266d krb5kdc[20690](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:29 dist-test-slave-266d krb5kdc[20690](info): set up 2 sockets
Aug 09 18:56:29 dist-test-slave-266d krb5kdc[20690](info): commencing operation
krb5kdc: starting...
W20260809 18:56:30.438192 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:30 dist-test-slave-266d krb5kdc[20690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:30.618268 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:43821
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:40343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:43821
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:30.946034 20715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:30.946306 20715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:30.946398 20715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:30.953296 20715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:30.953387 20715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:30.953439 20715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:30.953493 20715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:30.953534 20715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:30.962743 20715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:40343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:43821
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:43821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:30.963881 20715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:30.965058 20715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:30.976203 20722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:30.976168 20724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:30.976238 20721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:30.976886 20715 server_base.cc:1034] running on GCE node
I20260809 18:56:30.977669 20715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:30.978962 20715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:30.980172 20715 hybrid_clock.cc:648] HybridClock initialized: now 1786301790980117 us; error 37 us; skew 500 ppm
I20260809 18:56:30.980479 20715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:30 dist-test-slave-266d krb5kdc[20690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301790, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:30.983404 20715 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:30.984720 20715 webserver.cc:460] Webserver started at http://127.16.188.254:46257/ using document root <none> and password file <none>
I20260809 18:56:30.985410 20715 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:30.985529 20715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:30.985822 20715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:30.988724 20715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "fc1f322225af455289cdab7d6f53595d"
format_stamp: "Formatted at 2026-08-09 18:56:30 on dist-test-slave-266d"
server_key: "a6ed0c0166a2f48cb6bdf8f2d0c29d35"
server_key_iv: "7722975140a5909ec5b1cad98fda7b66"
server_key_version: "encryptionkey@0"
I20260809 18:56:30.989476 20715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "fc1f322225af455289cdab7d6f53595d"
format_stamp: "Formatted at 2026-08-09 18:56:30 on dist-test-slave-266d"
server_key: "a6ed0c0166a2f48cb6bdf8f2d0c29d35"
server_key_iv: "7722975140a5909ec5b1cad98fda7b66"
server_key_version: "encryptionkey@0"
I20260809 18:56:30.994468 20715 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:56:30.997700 20731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:30.998876 20715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:30.999038 20715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "fc1f322225af455289cdab7d6f53595d"
format_stamp: "Formatted at 2026-08-09 18:56:30 on dist-test-slave-266d"
server_key: "a6ed0c0166a2f48cb6bdf8f2d0c29d35"
server_key_iv: "7722975140a5909ec5b1cad98fda7b66"
server_key_version: "encryptionkey@0"
I20260809 18:56:30.999213 20715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:31.013000 20715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:31.016484 20715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:31.016727 20715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:31.032872 20715 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:43821
I20260809 18:56:31.032895 20803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:43821 every 8 connection(s)
I20260809 18:56:31.034180 20715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:31.037756 20804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:31.043550 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20715
I20260809 18:56:31.043747 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:31.044391 17139 external_mini_cluster.cc:1428] Setting key 8cc7262b4c88dea69c97d2d8fae8b71f
I20260809 18:56:31.047660 20804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d: Bootstrap starting.
I20260809 18:56:31.050923 20804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:31.052083 20804 log.cc:824] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:31.054972 20804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d: No bootstrap required, opened a new log
Aug 09 18:56:31 dist-test-slave-266d krb5kdc[20690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:31.064090 20804 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1f322225af455289cdab7d6f53595d" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43821 } }
I20260809 18:56:31.064515 20804 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:31.064639 20804 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1f322225af455289cdab7d6f53595d, State: Initialized, Role: FOLLOWER
I20260809 18:56:31.065304 20804 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1f322225af455289cdab7d6f53595d" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43821 } }
I20260809 18:56:31.065587 20804 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:31.065755 20804 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:31.065984 20804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:31.067459 20807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:31.046331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39542 (local address 127.16.188.254:43821)
0809 18:56:31.047099 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:31.047117 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:31.047158 (+ 41us) server_negotiation.cc:407] Connection header received
0809 18:56:31.048855 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:31.048878 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:31.049310 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:31.049620 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:31.051432 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.052905 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.054252 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.055255 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.055448 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:31.059078 (+ 3630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:31.059090 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:31.059119 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:31.059181 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:31.063044 (+ 3863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.063670 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.063678 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.063686 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.063887 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.064201 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.064206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.064209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.064918 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:31.065251 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:31.065644 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 18:56:31.066091 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":336,"threads_started":1}
I20260809 18:56:31.068850 20804 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1f322225af455289cdab7d6f53595d" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43821 } }
I20260809 18:56:31.069442 20804 leader_election.cc:302] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc1f322225af455289cdab7d6f53595d; no voters:
I20260809 18:56:31.070063 20804 leader_election.cc:288] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:31.070163 20810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:31.071154 20810 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [term 1 LEADER]: Becoming Leader. State: Replica: fc1f322225af455289cdab7d6f53595d, State: Running, Role: LEADER
I20260809 18:56:31.071601 20810 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1f322225af455289cdab7d6f53595d" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43821 } }
I20260809 18:56:31.072045 20804 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:31.074383 20812 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc1f322225af455289cdab7d6f53595d. Latest consensus state: current_term: 1 leader_uuid: "fc1f322225af455289cdab7d6f53595d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1f322225af455289cdab7d6f53595d" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43821 } } }
I20260809 18:56:31.074280 20811 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc1f322225af455289cdab7d6f53595d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1f322225af455289cdab7d6f53595d" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43821 } } }
I20260809 18:56:31.076718 20812 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:31.076851 20811 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:31.077862 20819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:31.084043 20819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:31.095178 20819 catalog_manager.cc:1347] Generated new cluster ID: 7af3c3d91db14a0b92c81360b513782b
I20260809 18:56:31.095273 20819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:31.127748 20819 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:31.129065 20819 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:31.135136 20819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc1f322225af455289cdab7d6f53595d: Generated new TSK 0
I20260809 18:56:31.135924 20819 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:31.190374 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43821
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:40343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:31.508036 20843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:31.508293 20843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:31.508410 20843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:31.515300 20843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:31.515391 20843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:31.515535 20843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:31.524864 20843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:40343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:31.526007 20843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:31.527264 20843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:31.539779 20851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:31.539780 20848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:31.539806 20849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:31.540491 20843 server_base.cc:1034] running on GCE node
I20260809 18:56:31.541235 20843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:31.542122 20843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:31.543315 20843 hybrid_clock.cc:648] HybridClock initialized: now 1786301791543267 us; error 45 us; skew 500 ppm
I20260809 18:56:31.543604 20843 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:31 dist-test-slave-266d krb5kdc[20690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:31.546574 20843 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:31.547875 20843 webserver.cc:460] Webserver started at http://127.16.188.193:44613/ using document root <none> and password file <none>
I20260809 18:56:31.548475 20843 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:31.548570 20843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:31.548822 20843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:31.551578 20843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "91ce52640cd649c0be051992d74b948c"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-266d"
server_key: "78ad911b787cb183679c939d9adfd425"
server_key_iv: "d02f8487b249f0bb3739ef5c5a6e4e56"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.552295 20843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "91ce52640cd649c0be051992d74b948c"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-266d"
server_key: "78ad911b787cb183679c939d9adfd425"
server_key_iv: "d02f8487b249f0bb3739ef5c5a6e4e56"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.557471 20843 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 18:56:31.560613 20862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.561847 20843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:31.561978 20843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "91ce52640cd649c0be051992d74b948c"
format_stamp: "Formatted at 2026-08-09 18:56:31 on dist-test-slave-266d"
server_key: "78ad911b787cb183679c939d9adfd425"
server_key_iv: "d02f8487b249f0bb3739ef5c5a6e4e56"
server_key_version: "encryptionkey@0"
I20260809 18:56:31.562139 20843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:31.575590 20843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:31.579180 20843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:31.579402 20843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:31.580227 20843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:31.581422 20843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:31.581493 20843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.581584 20843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:31.581631 20843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:31.611152 20843 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:46879
I20260809 18:56:31.611200 21029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:46879 every 8 connection(s)
I20260809 18:56:31.612321 20843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:31.618294 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20843
I20260809 18:56:31.618474 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:31.619081 17139 external_mini_cluster.cc:1428] Setting key 5287bb3152569ba94db6b9b7b0f5fe0f
Aug 09 18:56:31 dist-test-slave-266d krb5kdc[20690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301791, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:31.631991 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:31.614700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:43911 (local address 127.16.188.254:43821)
0809 18:56:31.615152 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:31.615157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:31.616051 (+ 894us) server_negotiation.cc:407] Connection header received
0809 18:56:31.617878 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:31.617884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:31.617975 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:31.618071 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:31.619609 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.620523 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.622081 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.622470 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.622578 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:31.625844 (+ 3266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:31.625851 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:31.625855 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:31.625893 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:31.628402 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.629210 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.629213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.629216 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.629330 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:31.629796 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:31.629801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:31.629804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:31.630159 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:31.630313 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:31.631169 (+ 856us) server_negotiation.cc:299] Negotiation successful
0809 18:56:31.631483 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":219,"threads_started":1}
I20260809 18:56:31.632781 21034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:31.615213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43821 (local address 127.16.188.193:43911)
0809 18:56:31.615898 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:31.615935 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:31.617623 (+ 1688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:31.618322 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:31.618330 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:31.618883 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:31.619447 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:31.619466 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.620718 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.620722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:31.621944 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:31.621956 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:31.622682 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:31.622691 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:31.622907 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:31.623523 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:31.623545 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:31.625636 (+ 2091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:31.628548 (+ 2912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:31.628557 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:31.628571 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:31.629112 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:31.629418 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:31.629422 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:31.629425 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:31.629660 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:31.630375 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:31.630381 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:31.630688 (+ 307us) client_negotiation.cc:769] Sending connection context
0809 18:56:31.630977 (+ 289us) client_negotiation.cc:240] Negotiation successful
0809 18:56:31.631483 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":256,"threads_started":1}
I20260809 18:56:31.634244 21031 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43821
I20260809 18:56:31.634505 21031 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:31.635201 21031 heartbeater.cc:511] Master 127.16.188.254:43821 requested a full tablet report, sending...
I20260809 18:56:31.637526 20756 ts_manager.cc:194] Registered new tserver with Master: 91ce52640cd649c0be051992d74b948c (127.16.188.193:46879)
I20260809 18:56:31.639521 20756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:43911
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:31.664202 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43821
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:40343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:31.985584 21037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:31.985870 21037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:31.985982 21037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:31.992923 21037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:31.993021 21037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:31.993183 21037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:32.002490 21037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:40343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:32.003718 21037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:32.004957 21037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:32.017225 21045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:32.017267 21043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:32.017449 21042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:32.018030 21037 server_base.cc:1034] running on GCE node
I20260809 18:56:32.018616 21037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:32.019486 21037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:32.020674 21037 hybrid_clock.cc:648] HybridClock initialized: now 1786301792020632 us; error 56 us; skew 500 ppm
I20260809 18:56:32.020963 21037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:32 dist-test-slave-266d krb5kdc[20690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:32.023856 21037 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:32.025215 21037 webserver.cc:460] Webserver started at http://127.16.188.194:36909/ using document root <none> and password file <none>
I20260809 18:56:32.025854 21037 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:32.025969 21037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:32.026244 21037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:32.028927 21037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "4ed3d69e3256497e978b503df9f8c255"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-266d"
server_key: "1ecccaebef8de91065667d09574f5471"
server_key_iv: "1cb9faad892b88e1be7bcd23abbcd0ef"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.029745 21037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "4ed3d69e3256497e978b503df9f8c255"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-266d"
server_key: "1ecccaebef8de91065667d09574f5471"
server_key_iv: "1cb9faad892b88e1be7bcd23abbcd0ef"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.034650 21037 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:56:32.037967 21054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.039201 21037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:32.039359 21037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "4ed3d69e3256497e978b503df9f8c255"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-266d"
server_key: "1ecccaebef8de91065667d09574f5471"
server_key_iv: "1cb9faad892b88e1be7bcd23abbcd0ef"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.039526 21037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:32.056282 21037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:32.060082 21037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:32.060343 21037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:32.061251 21037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:32.062636 21037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:32.062726 21037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.062824 21037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:32.062876 21037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.093355 21037 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:46227
I20260809 18:56:32.093389 21229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:46227 every 8 connection(s)
I20260809 18:56:32.094548 21037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:32.102598 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 21037
I20260809 18:56:32.102785 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:32.103250 17139 external_mini_cluster.cc:1428] Setting key 34e6e0c1c5a7c33a4f4c57237d657e5b
Aug 09 18:56:32 dist-test-slave-266d krb5kdc[20690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:32.113360 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.096960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:45545 (local address 127.16.188.254:43821)
0809 18:56:32.097178 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.097182 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.098308 (+ 1126us) server_negotiation.cc:407] Connection header received
0809 18:56:32.100095 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.100100 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.100185 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.100281 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:32.101790 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.102564 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.104210 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.104675 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.104786 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.108028 (+ 3242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:32.108034 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:32.108037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:32.108072 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:32.110534 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.111203 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.111207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.111209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.111336 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.111739 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.111743 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.111745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.111989 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:32.112120 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.112781 (+ 661us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.112999 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":57}
I20260809 18:56:32.114255 21234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.097429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43821 (local address 127.16.188.194:45545)
0809 18:56:32.098145 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:32.098190 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:32.099830 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:32.100515 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:32.100523 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:32.101026 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:32.101628 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.101648 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.102727 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.102733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.104060 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.104074 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.104899 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.104907 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.105169 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.105778 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:32.105806 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:32.107830 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:32.110665 (+ 2835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:32.110674 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:32.110689 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:32.111073 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:32.111440 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:32.111445 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:32.111449 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:32.111627 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:32.112121 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:32.112129 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:32.112427 (+ 298us) client_negotiation.cc:769] Sending connection context
0809 18:56:32.112653 (+ 226us) client_negotiation.cc:240] Negotiation successful
0809 18:56:32.113165 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":260,"threads_started":1}
I20260809 18:56:32.115614 21232 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43821
I20260809 18:56:32.115885 21232 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:32.116591 21232 heartbeater.cc:511] Master 127.16.188.254:43821 requested a full tablet report, sending...
I20260809 18:56:32.118062 20756 ts_manager.cc:194] Registered new tserver with Master: 4ed3d69e3256497e978b503df9f8c255 (127.16.188.194:46227)
I20260809 18:56:32.119163 20756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:45545
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:56:32.145779 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43821
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:40343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:32.468571 21238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:32.468825 21238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:32.468923 21238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:32.475863 21238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:32.475965 21238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:32.476078 21238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:32.485369 21238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:40343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:32.486498 21238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:32.487741 21238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:32.500361 21247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:32.500424 21248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:32.500455 21253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:32.501185 21238 server_base.cc:1034] running on GCE node
I20260809 18:56:32.501775 21238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:32.502678 21238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:32.503891 21238 hybrid_clock.cc:648] HybridClock initialized: now 1786301792503838 us; error 47 us; skew 500 ppm
I20260809 18:56:32.504184 21238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:32 dist-test-slave-266d krb5kdc[20690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:32.507179 21238 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:32.508591 21238 webserver.cc:460] Webserver started at http://127.16.188.195:40435/ using document root <none> and password file <none>
I20260809 18:56:32.509294 21238 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:32.509436 21238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:32.509732 21238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:32.512446 21238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "d21eb00b266e4099bd757e9856087b7e"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-266d"
server_key: "f62a8907bf8d769f6a228266dc17a264"
server_key_iv: "d4dc5f28307d7bf332cf011a6f17f263"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.513226 21238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "d21eb00b266e4099bd757e9856087b7e"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-266d"
server_key: "f62a8907bf8d769f6a228266dc17a264"
server_key_iv: "d4dc5f28307d7bf332cf011a6f17f263"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.518070 21238 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:56:32.521219 21261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.522464 21238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 18:56:32.522608 21238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "d21eb00b266e4099bd757e9856087b7e"
format_stamp: "Formatted at 2026-08-09 18:56:32 on dist-test-slave-266d"
server_key: "f62a8907bf8d769f6a228266dc17a264"
server_key_iv: "d4dc5f28307d7bf332cf011a6f17f263"
server_key_version: "encryptionkey@0"
I20260809 18:56:32.522776 21238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:32.535079 21238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:32.538983 21238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:32.539238 21238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:32.540102 21238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:32.541435 21238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:32.541507 21238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.541636 21238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:32.541692 21238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:32.572592 21238 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:42603
I20260809 18:56:32.572657 21451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:42603 every 8 connection(s)
I20260809 18:56:32.573865 21238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:32.580963 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 21238
I20260809 18:56:32.581164 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:32.581703 17139 external_mini_cluster.cc:1428] Setting key dc00a32d95a75cb54008a84cf63d884e
Aug 09 18:56:32 dist-test-slave-266d krb5kdc[20690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301792, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:32.592087 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.576227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:55393 (local address 127.16.188.254:43821)
0809 18:56:32.576437 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.576444 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.577601 (+ 1157us) server_negotiation.cc:407] Connection header received
0809 18:56:32.579396 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.579400 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.579483 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.579567 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:32.580979 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.582044 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.583659 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.584075 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.584167 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.587391 (+ 3224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:32.587396 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:32.587399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:32.587432 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:32.589697 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.590285 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.590288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.590290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.590398 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:32.590790 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:32.590793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:32.590796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:32.591048 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:32.591154 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:32.591703 (+ 549us) server_negotiation.cc:299] Negotiation successful
0809 18:56:32.591848 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 18:56:32.592962 21454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:32.576719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43821 (local address 127.16.188.195:55393)
0809 18:56:32.577451 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:32.577495 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:32.579118 (+ 1623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:32.579791 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:32.579798 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:32.580278 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:32.580816 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.580832 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.582191 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.582195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.583516 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:32.583529 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:32.584290 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:32.584299 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:32.584576 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:32.585201 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:32.585223 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:32.587199 (+ 1976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:32.589816 (+ 2617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:32.589822 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:32.589832 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:32.590205 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:32.590493 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:32.590496 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:32.590498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:32.590699 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:32.591155 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:32.591161 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:32.591428 (+ 267us) client_negotiation.cc:769] Sending connection context
0809 18:56:32.591650 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 18:56:32.591979 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":310,"threads_started":1}
I20260809 18:56:32.594129 21452 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43821
I20260809 18:56:32.594367 21452 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:32.595078 21452 heartbeater.cc:511] Master 127.16.188.254:43821 requested a full tablet report, sending...
I20260809 18:56:32.596665 20754 ts_manager.cc:194] Registered new tserver with Master: d21eb00b266e4099bd757e9856087b7e (127.16.188.195:42603)
I20260809 18:56:32.597507 20754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:55393
I20260809 18:56:32.608386 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:56:32.641912 21033 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:32.639499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39552 (local address 127.16.188.254:43821)
0809 18:56:32.639675 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:32.639683 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:32.640106 (+ 423us) server_negotiation.cc:407] Connection header received
0809 18:56:32.640292 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:32.640302 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:32.640370 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:32.640455 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:32.641705 (+ 1250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39552: BlockingRecv error: recv got EOF from 127.0.0.1:39552 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:56:32.642493 21031 heartbeater.cc:503] Master 127.16.188.254:43821 was elected leader, sending a full tablet report...
I20260809 18:56:32.645011 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20843
W20260809 18:56:32.647495 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20843: Not authorized: Client connection negotiation failed: client connection to 127.16.188.193:46879: server requires authentication, but client does not have Kerberos credentials available
I20260809 18:56:32.647655 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20843
I20260809 18:56:32.686650 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 21037
W20260809 18:56:32.689241 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 21037: Not authorized: Client connection negotiation failed: client connection to 127.16.188.194:46227: server requires authentication, but client does not have Kerberos credentials available
I20260809 18:56:32.689368 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 21037
I20260809 18:56:32.707033 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 21238
W20260809 18:56:32.709553 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 21238: Not authorized: Client connection negotiation failed: client connection to 127.16.188.195:42603: server requires authentication, but client does not have Kerberos credentials available
I20260809 18:56:32.709697 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 21238
I20260809 18:56:32.729168 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20715
I20260809 18:56:32.730228 20798 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:32.829980 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20715
2026-08-09T18:56:32Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3582 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:32 dist-test-slave-266d krb5kdc[21478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:32 dist-test-slave-266d krb5kdc[21478](info): set up 2 sockets
Aug 09 18:56:32 dist-test-slave-266d krb5kdc[21478](info): commencing operation
krb5kdc: starting...
W20260809 18:56:34.067109 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.003s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:34 dist-test-slave-266d krb5kdc[21478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:34.250672 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:35723
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:37611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:35723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:34.565213 21499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:34.565480 21499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:34.565621 21499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:34.572633 21499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:34.572728 21499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:34.572804 21499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:34.572881 21499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:34.572944 21499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:34.582286 21499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:35723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:35723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:34.583442 21499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:34.584687 21499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:34.595872 21512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:34.595882 21515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:34.595918 21510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:34.596768 21499 server_base.cc:1034] running on GCE node
I20260809 18:56:34.597535 21499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:34.598783 21499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:34.599972 21499 hybrid_clock.cc:648] HybridClock initialized: now 1786301794599926 us; error 38 us; skew 500 ppm
I20260809 18:56:34.600262 21499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:34 dist-test-slave-266d krb5kdc[21478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:34.607420 21499 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:34.608696 21499 webserver.cc:460] Webserver started at http://127.16.188.254:39441/ using document root <none> and password file <none>
I20260809 18:56:34.609364 21499 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:34.609474 21499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:34.609762 21499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:34.612593 21499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "9bffed7ee1d14db38789eb5c98e2cf69"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-266d"
server_key: "ab5ebfe24bf751021ec0794049ac5932"
server_key_iv: "c37ab6476fe211e20aa222e3b123cb87"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.613412 21499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "9bffed7ee1d14db38789eb5c98e2cf69"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-266d"
server_key: "ab5ebfe24bf751021ec0794049ac5932"
server_key_iv: "c37ab6476fe211e20aa222e3b123cb87"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.618162 21499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 18:56:34.621320 21524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:34.622473 21499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 18:56:34.622625 21499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "9bffed7ee1d14db38789eb5c98e2cf69"
format_stamp: "Formatted at 2026-08-09 18:56:34 on dist-test-slave-266d"
server_key: "ab5ebfe24bf751021ec0794049ac5932"
server_key_iv: "c37ab6476fe211e20aa222e3b123cb87"
server_key_version: "encryptionkey@0"
I20260809 18:56:34.622793 21499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:34.635540 21499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:34.638937 21499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:34.639194 21499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:34.656401 21499 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:35723
I20260809 18:56:34.656435 21596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:35723 every 8 connection(s)
I20260809 18:56:34.657681 21499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:34.661192 21597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:34.665724 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 21499
I20260809 18:56:34.665992 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:34.666785 17139 external_mini_cluster.cc:1428] Setting key 817495c861dd7b2834ea536a63867318
I20260809 18:56:34.672106 21597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69: Bootstrap starting.
I20260809 18:56:34.675493 21597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:34.676677 21597 log.cc:824] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:34.679136 21597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69: No bootstrap required, opened a new log
Aug 09 18:56:34 dist-test-slave-266d krb5kdc[21478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:34.687759 21597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bffed7ee1d14db38789eb5c98e2cf69" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35723 } }
I20260809 18:56:34.688074 21597 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:34.688171 21597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bffed7ee1d14db38789eb5c98e2cf69, State: Initialized, Role: FOLLOWER
I20260809 18:56:34.688344 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.668520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49456 (local address 127.16.188.254:35723)
0809 18:56:34.669319 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.669329 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.669368 (+ 39us) server_negotiation.cc:407] Connection header received
0809 18:56:34.671061 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.671089 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.671418 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.671707 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.673528 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.674795 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.676469 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.677179 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.677376 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.681457 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.681467 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.681481 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:34.681520 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.684426 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.685197 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.685203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.685212 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.685379 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:34.685743 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:34.685746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:34.685748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:34.686303 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.686518 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.687000 (+ 482us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.687377 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":351,"threads_started":1}
I20260809 18:56:34.688769 21597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bffed7ee1d14db38789eb5c98e2cf69" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35723 } }
I20260809 18:56:34.689050 21597 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:34.689213 21597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:34.689405 21597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:34.691862 21597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bffed7ee1d14db38789eb5c98e2cf69" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35723 } }
I20260809 18:56:34.691988 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:34.692320 21597 leader_election.cc:302] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bffed7ee1d14db38789eb5c98e2cf69; no voters:
I20260809 18:56:34.692852 21597 leader_election.cc:288] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:34.692986 21603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:34.694643 21597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:34.709190 21603 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [term 1 LEADER]: Becoming Leader. State: Replica: 9bffed7ee1d14db38789eb5c98e2cf69, State: Running, Role: LEADER
I20260809 18:56:34.709646 21603 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bffed7ee1d14db38789eb5c98e2cf69" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35723 } }
I20260809 18:56:34.712217 21607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bffed7ee1d14db38789eb5c98e2cf69. Latest consensus state: current_term: 1 leader_uuid: "9bffed7ee1d14db38789eb5c98e2cf69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bffed7ee1d14db38789eb5c98e2cf69" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35723 } } }
I20260809 18:56:34.712194 21606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bffed7ee1d14db38789eb5c98e2cf69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bffed7ee1d14db38789eb5c98e2cf69" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35723 } } }
I20260809 18:56:34.712638 21607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:34.712679 21606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:34.717332 21625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:34.725028 21625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:34.734354 21625 catalog_manager.cc:1347] Generated new cluster ID: 84ac51e6d6a14478b7cf63a697e8a732
I20260809 18:56:34.734459 21625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:34.738607 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:34.730713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49458 (local address 127.16.188.254:35723)
0809 18:56:34.730903 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:34.730910 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:34.730926 (+ 16us) server_negotiation.cc:407] Connection header received
0809 18:56:34.730970 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:34.730973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:34.731030 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:34.731116 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:34.732285 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.733007 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.734491 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:34.735138 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:34.735241 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:34.736685 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:34.736693 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:34.736699 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:34.737710 (+ 1011us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:34.737793 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:34.737843 (+ 50us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:34.737972 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:34.738106 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 18:56:34.738215 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 18:56:34.743188 21625 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:34.744311 21625 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:34.754347 21625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9bffed7ee1d14db38789eb5c98e2cf69: Generated new TSK 0
I20260809 18:56:34.755330 21625 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:56:34.767024 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 21499
I20260809 18:56:34.768049 21589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:34.853446 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 21499
2026-08-09T18:56:34Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2009 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:34 dist-test-slave-266d krb5kdc[21646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:34 dist-test-slave-266d krb5kdc[21646](info): set up 2 sockets
Aug 09 18:56:34 dist-test-slave-266d krb5kdc[21646](info): commencing operation
krb5kdc: starting...
W20260809 18:56:36.029717 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.004s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:36 dist-test-slave-266d krb5kdc[21646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:36.214176 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:45741
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:45741
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:36.536111 21665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:36.536423 21665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:36.536559 21665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:36.543644 21665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:36.543751 21665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:36.543829 21665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:36.543901 21665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:36.543956 21665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:36.553429 21665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:45741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:45741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:36.554689 21665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:36.555941 21665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:36.567178 21677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:36.567221 21671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:36.567247 21672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:36.568257 21665 server_base.cc:1034] running on GCE node
I20260809 18:56:36.568948 21665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:36.570263 21665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:36.571467 21665 hybrid_clock.cc:648] HybridClock initialized: now 1786301796571417 us; error 33 us; skew 500 ppm
I20260809 18:56:36.571787 21665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:36 dist-test-slave-266d krb5kdc[21646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:36.574820 21665 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:36.576197 21665 webserver.cc:460] Webserver started at http://127.16.188.254:42083/ using document root <none> and password file <none>
I20260809 18:56:36.576841 21665 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:36.576956 21665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:36.577292 21665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:36.580114 21665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "ceeb7a0a020f4448a931e62e424fb746"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-266d"
server_key: "abe671af01198a0d1ddf4931ed52ed8c"
server_key_iv: "57ddcdc1b62545f2aa7ed1710e51bd9e"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.580847 21665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "ceeb7a0a020f4448a931e62e424fb746"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-266d"
server_key: "abe671af01198a0d1ddf4931ed52ed8c"
server_key_iv: "57ddcdc1b62545f2aa7ed1710e51bd9e"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.585606 21665 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 18:56:36.588728 21689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:36.589994 21665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:36.590155 21665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "ceeb7a0a020f4448a931e62e424fb746"
format_stamp: "Formatted at 2026-08-09 18:56:36 on dist-test-slave-266d"
server_key: "abe671af01198a0d1ddf4931ed52ed8c"
server_key_iv: "57ddcdc1b62545f2aa7ed1710e51bd9e"
server_key_version: "encryptionkey@0"
I20260809 18:56:36.590327 21665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:36.607198 21665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:36.610895 21665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:36.611145 21665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:36.627771 21665 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:45741
I20260809 18:56:36.627807 21769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:45741 every 8 connection(s)
I20260809 18:56:36.628993 21665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:36.629317 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 21665
I20260809 18:56:36.629529 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:36.630257 17139 external_mini_cluster.cc:1428] Setting key 81cc5b852b33a02737f5631bc778c7a6
I20260809 18:56:36.633081 21770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 18:56:36 dist-test-slave-266d krb5kdc[21646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:36.644941 21770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746: Bootstrap starting.
I20260809 18:56:36.648747 21770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:36.649926 21770 log.cc:824] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:36.653147 21770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746: No bootstrap required, opened a new log
I20260809 18:56:36.653525 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:36.632147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58772 (local address 127.16.188.254:45741)
0809 18:56:36.632934 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:36.632947 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:36.632997 (+ 50us) server_negotiation.cc:407] Connection header received
0809 18:56:36.635177 (+ 2180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:36.635205 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:36.635678 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:36.636087 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:36.637372 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.639401 (+ 2029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.640644 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:36.641649 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:36.641832 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:36.645446 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:36.645455 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:36.645472 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:36.645513 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:36.649392 (+ 3879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.650059 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.650066 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.650074 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.650272 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:36.650718 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:36.650721 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:36.650723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:36.651242 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:36.651519 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:36.651863 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 18:56:36.652268 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":320,"threads_started":1}
I20260809 18:56:36.661343 21770 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeb7a0a020f4448a931e62e424fb746" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45741 } }
I20260809 18:56:36.661655 21770 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:36.661729 21770 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceeb7a0a020f4448a931e62e424fb746, State: Initialized, Role: FOLLOWER
I20260809 18:56:36.662292 21770 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeb7a0a020f4448a931e62e424fb746" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45741 } }
I20260809 18:56:36.662569 21770 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:36.662720 21770 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:36.662897 21770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:36.664911 21770 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeb7a0a020f4448a931e62e424fb746" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45741 } }
I20260809 18:56:36.665369 21770 leader_election.cc:302] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceeb7a0a020f4448a931e62e424fb746; no voters:
I20260809 18:56:36.665874 21770 leader_election.cc:288] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:36.665982 21779 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:36.666572 21779 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [term 1 LEADER]: Becoming Leader. State: Replica: ceeb7a0a020f4448a931e62e424fb746, State: Running, Role: LEADER
I20260809 18:56:36.667088 21779 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeb7a0a020f4448a931e62e424fb746" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45741 } }
I20260809 18:56:36.667917 21770 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:36.669765 21780 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceeb7a0a020f4448a931e62e424fb746" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeb7a0a020f4448a931e62e424fb746" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45741 } } }
I20260809 18:56:36.670101 21780 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:36.672720 21781 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceeb7a0a020f4448a931e62e424fb746. Latest consensus state: current_term: 1 leader_uuid: "ceeb7a0a020f4448a931e62e424fb746" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeb7a0a020f4448a931e62e424fb746" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45741 } } }
I20260809 18:56:36.673112 21781 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:36.673655 21787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:36.678390 21787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:36.686852 21787 catalog_manager.cc:1347] Generated new cluster ID: 22bdf3f38b0f4c5589f59def419d3991
I20260809 18:56:36.686957 21787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:36.698226 21787 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:36.699368 21787 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:36.707844 21787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceeb7a0a020f4448a931e62e424fb746: Generated new TSK 0
I20260809 18:56:36.708515 21787 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:36.762957 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45741
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:37.082085 21805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:37.082353 21805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:37.082485 21805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:37.089637 21805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:37.089740 21805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:37.089893 21805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:37.099406 21805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:37.100682 21805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:37.101989 21805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:37.114835 21810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:37.114794 21817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:37.114871 21811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:37.115621 21805 server_base.cc:1034] running on GCE node
I20260809 18:56:37.116168 21805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:37.117034 21805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:37.118263 21805 hybrid_clock.cc:648] HybridClock initialized: now 1786301797118214 us; error 43 us; skew 500 ppm
I20260809 18:56:37.118551 21805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:37 dist-test-slave-266d krb5kdc[21646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301797, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:37.121618 21805 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:37.122931 21805 webserver.cc:460] Webserver started at http://127.16.188.193:38377/ using document root <none> and password file <none>
I20260809 18:56:37.123556 21805 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:37.123672 21805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:37.123989 21805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:37.126808 21805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "d0f5250ad8a74a27b906001002721e8f"
format_stamp: "Formatted at 2026-08-09 18:56:37 on dist-test-slave-266d"
server_key: "e628785e0f5f3a4aaab57c76608a7d03"
server_key_iv: "8c09fbed4e0df2c6f7e23db88cdfee77"
server_key_version: "encryptionkey@0"
I20260809 18:56:37.127508 21805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "d0f5250ad8a74a27b906001002721e8f"
format_stamp: "Formatted at 2026-08-09 18:56:37 on dist-test-slave-266d"
server_key: "e628785e0f5f3a4aaab57c76608a7d03"
server_key_iv: "8c09fbed4e0df2c6f7e23db88cdfee77"
server_key_version: "encryptionkey@0"
I20260809 18:56:37.132295 21805 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 18:56:37.135545 21831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:37.136791 21805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:37.136921 21805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "d0f5250ad8a74a27b906001002721e8f"
format_stamp: "Formatted at 2026-08-09 18:56:37 on dist-test-slave-266d"
server_key: "e628785e0f5f3a4aaab57c76608a7d03"
server_key_iv: "8c09fbed4e0df2c6f7e23db88cdfee77"
server_key_version: "encryptionkey@0"
I20260809 18:56:37.137068 21805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:37.157655 21805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:37.161561 21805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:37.161806 21805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:37.162672 21805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:37.163929 21805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:37.164039 21805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:37.164152 21805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:37.164216 21805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:37.193697 21805 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:37759
I20260809 18:56:37.193753 22009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:37759 every 8 connection(s)
I20260809 18:56:37.194995 21805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:37.201428 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 21805
I20260809 18:56:37.201625 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:37.202320 17139 external_mini_cluster.cc:1428] Setting key cc02527425751060809f565c4aa05729
Aug 09 18:56:37 dist-test-slave-266d krb5kdc[21646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301797, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:37.214412 22015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.197390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:46441 (local address 127.16.188.254:45741)
0809 18:56:37.197796 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.197801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.198759 (+ 958us) server_negotiation.cc:407] Connection header received
0809 18:56:37.200442 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.200446 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.200510 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.200617 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:37.202102 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.203075 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.204676 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.205252 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.205376 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.208682 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:37.208689 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:37.208693 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:37.208733 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:37.211305 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:37.211987 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:37.211993 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:37.211996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:37.212147 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:37.212508 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:37.212513 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:37.212515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:37.212862 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:37.213000 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.213843 (+ 843us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.214064 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":209,"threads_started":1}
I20260809 18:56:37.215215 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.197925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45741 (local address 127.16.188.193:46441)
0809 18:56:37.198603 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.198641 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.200218 (+ 1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.200790 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.200798 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.201345 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:37.201931 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.201950 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.203221 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.203225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.204531 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.204543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.205435 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.205439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.205635 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.206251 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:37.206277 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:37.208456 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:37.211455 (+ 2999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:37.211464 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:37.211478 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:37.211870 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:37.212243 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:37.212246 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:37.212249 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:37.212413 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:37.212964 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:37.212969 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:37.213456 (+ 487us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.213731 (+ 275us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.214122 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":248,"threads_started":1}
I20260809 18:56:37.216740 22012 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45741
I20260809 18:56:37.217036 22012 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:37.217790 22012 heartbeater.cc:511] Master 127.16.188.254:45741 requested a full tablet report, sending...
I20260809 18:56:37.219907 21713 ts_manager.cc:194] Registered new tserver with Master: d0f5250ad8a74a27b906001002721e8f (127.16.188.193:37759)
I20260809 18:56:37.221410 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:46441
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:37.247493 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45741
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:37.562069 22020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:37.562321 22020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:37.562449 22020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:37.569479 22020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:37.569590 22020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:37.569746 22020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:37.578928 22020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:37.580111 22020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:37.581372 22020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:37.593910 22030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:37.593968 22035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:37.593940 22029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:37.594830 22020 server_base.cc:1034] running on GCE node
I20260809 18:56:37.595391 22020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:37.596205 22020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:37.597395 22020 hybrid_clock.cc:648] HybridClock initialized: now 1786301797597353 us; error 36 us; skew 500 ppm
I20260809 18:56:37.597684 22020 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:37 dist-test-slave-266d krb5kdc[21646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301797, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:37.600499 22020 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:37.601810 22020 webserver.cc:460] Webserver started at http://127.16.188.194:36679/ using document root <none> and password file <none>
I20260809 18:56:37.602481 22020 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:37.602594 22020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:37.602881 22020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:37.605645 22020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "74a9a455976e47a9b9f3a20bcb730e26"
format_stamp: "Formatted at 2026-08-09 18:56:37 on dist-test-slave-266d"
server_key: "724aca8b9973e6f40e53c7ee78fbe357"
server_key_iv: "4cfd1401eb50f8692b285de58a941654"
server_key_version: "encryptionkey@0"
I20260809 18:56:37.606403 22020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "74a9a455976e47a9b9f3a20bcb730e26"
format_stamp: "Formatted at 2026-08-09 18:56:37 on dist-test-slave-266d"
server_key: "724aca8b9973e6f40e53c7ee78fbe357"
server_key_iv: "4cfd1401eb50f8692b285de58a941654"
server_key_version: "encryptionkey@0"
I20260809 18:56:37.611214 22020 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 18:56:37.614429 22046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:37.615756 22020 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260809 18:56:37.615909 22020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "74a9a455976e47a9b9f3a20bcb730e26"
format_stamp: "Formatted at 2026-08-09 18:56:37 on dist-test-slave-266d"
server_key: "724aca8b9973e6f40e53c7ee78fbe357"
server_key_iv: "4cfd1401eb50f8692b285de58a941654"
server_key_version: "encryptionkey@0"
I20260809 18:56:37.616089 22020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:37.629635 22020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:37.633431 22020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:37.633692 22020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:37.634544 22020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:37.635777 22020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:37.635851 22020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:37.635962 22020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:37.636014 22020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:37.669157 22020 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:36131
I20260809 18:56:37.669224 22219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:36131 every 8 connection(s)
I20260809 18:56:37.670406 22020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:37.673388 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 22020
I20260809 18:56:37.673585 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:37.674167 17139 external_mini_cluster.cc:1428] Setting key 5860e0a1b359ccde2479edc452d1c97d
Aug 09 18:56:37 dist-test-slave-266d krb5kdc[21646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301797, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:37.690991 22015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.672810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:40643 (local address 127.16.188.254:45741)
0809 18:56:37.672978 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:37.672982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:37.674270 (+ 1288us) server_negotiation.cc:407] Connection header received
0809 18:56:37.676479 (+ 2209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:37.676484 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:37.676554 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:37.676635 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:37.678566 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.679331 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.681403 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.681815 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.681911 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.685560 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:37.685572 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:37.685576 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:37.685609 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:37.688010 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:37.688694 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:37.688698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:37.688700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:37.688834 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:37.689298 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:37.689303 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:37.689306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:37.689591 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:37.689733 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:37.690399 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 18:56:37.690671 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:56:37.691854 22223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:37.673270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45741 (local address 127.16.188.194:40643)
0809 18:56:37.674098 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:37.674157 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:37.676179 (+ 2022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:37.676910 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:37.676921 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:37.677616 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:37.678407 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.678435 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.679472 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.679477 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.681278 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:37.681293 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:37.682024 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:37.682031 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:37.682290 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:37.682930 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:37.682957 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:37.685345 (+ 2388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:37.688155 (+ 2810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:37.688164 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:37.688179 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:37.688571 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:37.688938 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:37.688943 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:37.688946 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:37.689188 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:37.689716 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:37.689723 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:37.690041 (+ 318us) client_negotiation.cc:769] Sending connection context
0809 18:56:37.690268 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 18:56:37.690785 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":327,"threads_started":1}
I20260809 18:56:37.693156 22221 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45741
I20260809 18:56:37.693486 22221 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:37.694428 22221 heartbeater.cc:511] Master 127.16.188.254:45741 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
I20260809 18:56:37.695973 21713 ts_manager.cc:194] Registered new tserver with Master: 74a9a455976e47a9b9f3a20bcb730e26 (127.16.188.194:36131)
I20260809 18:56:37.696851 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:40643
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:56:37.720335 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45741
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:38.035180 22231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:38.035439 22231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:38.035539 22231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:38.042526 22231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:38.042629 22231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:38.042747 22231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:38.051903 22231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:38.053057 22231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:38.054278 22231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:38.066217 22237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:38.066304 22238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:38.066305 22240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:38.067095 22231 server_base.cc:1034] running on GCE node
I20260809 18:56:38.067649 22231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:38.068537 22231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:38.069736 22231 hybrid_clock.cc:648] HybridClock initialized: now 1786301798069696 us; error 50 us; skew 500 ppm
I20260809 18:56:38.070027 22231 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[21646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:38.072899 22231 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:38.074319 22231 webserver.cc:460] Webserver started at http://127.16.188.195:43005/ using document root <none> and password file <none>
I20260809 18:56:38.074977 22231 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:38.075091 22231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:38.075384 22231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:38.078347 22231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "9a68f98714bf41ab8b9369a46f4649ad"
format_stamp: "Formatted at 2026-08-09 18:56:38 on dist-test-slave-266d"
server_key: "40c098e8ff803ba8241de9f7c5c0176b"
server_key_iv: "5e37978c23d00fb70a08d9dc7cdbbcc8"
server_key_version: "encryptionkey@0"
I20260809 18:56:38.079171 22231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "9a68f98714bf41ab8b9369a46f4649ad"
format_stamp: "Formatted at 2026-08-09 18:56:38 on dist-test-slave-266d"
server_key: "40c098e8ff803ba8241de9f7c5c0176b"
server_key_iv: "5e37978c23d00fb70a08d9dc7cdbbcc8"
server_key_version: "encryptionkey@0"
I20260809 18:56:38.084324 22231 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 18:56:38.087792 22254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:38.089125 22231 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:38.089293 22231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "9a68f98714bf41ab8b9369a46f4649ad"
format_stamp: "Formatted at 2026-08-09 18:56:38 on dist-test-slave-266d"
server_key: "40c098e8ff803ba8241de9f7c5c0176b"
server_key_iv: "5e37978c23d00fb70a08d9dc7cdbbcc8"
server_key_version: "encryptionkey@0"
I20260809 18:56:38.089478 22231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:38.128427 22231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:38.132200 22231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:38.132488 22231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:38.133482 22231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:38.134785 22231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:38.134863 22231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:38.134984 22231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:38.135046 22231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:38.165352 22231 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:33921
I20260809 18:56:38.165398 22436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:33921 every 8 connection(s)
I20260809 18:56:38.166711 22231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:38.176204 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 22231
I20260809 18:56:38.176388 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:38.176837 17139 external_mini_cluster.cc:1428] Setting key 6aeab2c2d5aa11820e37c3ddefea3d41
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[21646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:38.187091 22015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:38.169152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:36915 (local address 127.16.188.254:45741)
0809 18:56:38.169324 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:38.169328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:38.170458 (+ 1130us) server_negotiation.cc:407] Connection header received
0809 18:56:38.172261 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:38.172266 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:38.172350 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:38.172438 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:38.173919 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.174643 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.176128 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.176592 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.176709 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:38.180322 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:38.180326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:38.180330 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:38.180362 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:38.183491 (+ 3129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.184364 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.184370 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.184374 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.184514 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.185043 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.185048 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.185052 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.185425 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:38.185561 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:38.186520 (+ 959us) server_negotiation.cc:299] Negotiation successful
0809 18:56:38.186739 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 18:56:38.188339 22440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:38.169617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45741 (local address 127.16.188.195:36915)
0809 18:56:38.170311 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:38.170347 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:38.171988 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:38.172672 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:38.172680 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:38.173211 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:38.173753 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:38.173770 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.174782 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.174787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:38.175988 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:38.176001 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.176825 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.176832 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:38.177085 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:38.177744 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:38.177766 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:38.180142 (+ 2376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:38.183648 (+ 3506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:38.183657 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:38.183673 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:38.184252 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:38.184619 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:38.184624 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:38.184628 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:38.184895 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:38.185663 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:38.185671 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:38.186099 (+ 428us) client_negotiation.cc:769] Sending connection context
0809 18:56:38.186394 (+ 295us) client_negotiation.cc:240] Negotiation successful
0809 18:56:38.186921 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":274,"threads_started":1}
I20260809 18:56:38.191175 22437 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45741
I20260809 18:56:38.191489 22437 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:38.192386 22437 heartbeater.cc:511] Master 127.16.188.254:45741 requested a full tablet report, sending...
I20260809 18:56:38.194015 21713 ts_manager.cc:194] Registered new tserver with Master: 9a68f98714bf41ab8b9369a46f4649ad (127.16.188.195:33921)
I20260809 18:56:38.194988 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:36915
I20260809 18:56:38.204272 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:56:38.224380 22012 heartbeater.cc:503] Master 127.16.188.254:45741 was elected leader, sending a full tablet report...
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[21646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[21646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:38.255038 22015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:38.241613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58782 (local address 127.16.188.254:45741)
0809 18:56:38.241812 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:38.241818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:38.242220 (+ 402us) server_negotiation.cc:407] Connection header received
0809 18:56:38.242402 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:38.242406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:38.242473 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:38.242555 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:38.243945 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.244724 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.245993 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.246427 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.246543 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:38.250308 (+ 3765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:38.250313 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:38.250316 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:38.250351 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:38.252686 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.253334 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.253338 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.253340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.253467 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.253800 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.253804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.253806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.254125 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:38.254310 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:38.254581 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 18:56:38.254751 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 18:56:38.255678 21713 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58782
I20260809 18:56:38.257871 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 21805
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[21646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:38.274380 22450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:38.258910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43514 (local address 127.16.188.193:37759)
0809 18:56:38.259518 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:38.259525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:38.259551 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:56:38.259615 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:38.259621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:38.259843 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:38.259984 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:38.261181 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.262236 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.263462 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.264057 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.264178 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:38.268330 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:38.268344 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:38.268361 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:38.268401 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:38.271237 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.271951 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.271959 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.271962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.272111 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.272504 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.272508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.272510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.272899 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:38.273239 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:38.273650 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 18:56:38.273952 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":290,"threads_started":1}
W20260809 18:56:38.275897 22005 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:43514
W20260809 18:56:38.277115 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 21805: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:38.277343 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 21805
I20260809 18:56:38.304212 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 22020
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[21646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:56:38.320533 22451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:38.305440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36222 (local address 127.16.188.194:36131)
0809 18:56:38.305981 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:38.305989 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:38.306018 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:56:38.306083 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:38.306090 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:38.306314 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:38.306446 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:38.307682 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.308720 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.310011 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.310601 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.310721 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:38.314938 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:38.314954 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:38.314973 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:38.315016 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:38.317838 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.318535 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.318544 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.318546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.318717 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.319037 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.319040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.319042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.319413 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:38.319683 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:38.319940 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 18:56:38.320199 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":260,"threads_started":1}
W20260809 18:56:38.321952 22213 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36222
W20260809 18:56:38.323092 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 22020: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:38.323278 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 22020
I20260809 18:56:38.350673 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 22231
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[21646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301798, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:56:38.366236 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:38.351757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.16.188.195:33921)
0809 18:56:38.352481 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:38.352488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:38.352527 (+ 39us) server_negotiation.cc:407] Connection header received
0809 18:56:38.352590 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:38.352597 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:38.352828 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:38.352957 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:38.354278 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.355336 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.356489 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:38.357044 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:38.357227 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:38.361194 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:38.361205 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:38.361220 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:38.361259 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:38.363784 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.364376 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.364383 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.364385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.364504 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:38.364777 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:38.364780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:38.364782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:38.365175 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:38.365488 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:38.365643 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 18:56:38.365865 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":383,"threads_started":1}
W20260809 18:56:38.367503 22431 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58384
W20260809 18:56:38.368651 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 22231: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 18:56:38.368808 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 22231
I20260809 18:56:38.395884 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 21665
I20260809 18:56:38.397078 21762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:38.498373 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 21665
2026-08-09T18:56:38Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3654 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[22458](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[22458](info): set up 2 sockets
Aug 09 18:56:38 dist-test-slave-266d krb5kdc[22458](info): commencing operation
krb5kdc: starting...
W20260809 18:56:39.696117 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:39 dist-test-slave-266d krb5kdc[22458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:39.882184 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:43073
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:39797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:43073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:40.192287 22473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:40.192552 22473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:40.192683 22473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:40.199685 22473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:40.199790 22473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:40.199862 22473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:40.199930 22473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:40.199990 22473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:40.209414 22473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:43073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:43073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:40.210608 22473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:40.211866 22473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:40.222587 22481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:40.222635 22486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:40.222657 22482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:40.223923 22473 server_base.cc:1034] running on GCE node
I20260809 18:56:40.224664 22473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:40.226052 22473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:40.227248 22473 hybrid_clock.cc:648] HybridClock initialized: now 1786301800227199 us; error 38 us; skew 500 ppm
I20260809 18:56:40.227561 22473 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:40 dist-test-slave-266d krb5kdc[22458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301800, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:40.234354 22473 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:40.235757 22473 webserver.cc:460] Webserver started at http://127.16.188.254:39771/ using document root <none> and password file <none>
I20260809 18:56:40.236397 22473 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:40.236493 22473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:40.236743 22473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:40.239589 22473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "5632bbb036bf4c91a2dd5e5152521d80"
format_stamp: "Formatted at 2026-08-09 18:56:40 on dist-test-slave-266d"
server_key: "f56905748116eabfd0fa2487330deba5"
server_key_iv: "88c81c84110af3b1af38c9a4083dbb62"
server_key_version: "encryptionkey@0"
I20260809 18:56:40.240293 22473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "5632bbb036bf4c91a2dd5e5152521d80"
format_stamp: "Formatted at 2026-08-09 18:56:40 on dist-test-slave-266d"
server_key: "f56905748116eabfd0fa2487330deba5"
server_key_iv: "88c81c84110af3b1af38c9a4083dbb62"
server_key_version: "encryptionkey@0"
I20260809 18:56:40.245002 22473 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 18:56:40.248220 22500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:40.249460 22473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:40.249600 22473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "5632bbb036bf4c91a2dd5e5152521d80"
format_stamp: "Formatted at 2026-08-09 18:56:40 on dist-test-slave-266d"
server_key: "f56905748116eabfd0fa2487330deba5"
server_key_iv: "88c81c84110af3b1af38c9a4083dbb62"
server_key_version: "encryptionkey@0"
I20260809 18:56:40.249756 22473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:40.261582 22473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:40.265065 22473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:40.265333 22473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:40.281908 22473 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:43073
I20260809 18:56:40.281919 22579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:43073 every 8 connection(s)
I20260809 18:56:40.283149 22473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:40.286062 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 22473
I20260809 18:56:40.286235 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:40.286754 22580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:40.286865 17139 external_mini_cluster.cc:1428] Setting key df432f5eab3cc095fad00ead1927c18f
I20260809 18:56:40.300382 22580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80: Bootstrap starting.
Aug 09 18:56:40 dist-test-slave-266d krb5kdc[22458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:40.304065 22580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:40.305362 22580 log.cc:824] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:40.308458 22580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80: No bootstrap required, opened a new log
I20260809 18:56:40.309664 22585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:40.288623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33170 (local address 127.16.188.254:43073)
0809 18:56:40.289469 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:40.289483 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:40.289537 (+ 54us) server_negotiation.cc:407] Connection header received
0809 18:56:40.291435 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:40.291462 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:40.291918 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:40.292345 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:40.293657 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:40.295564 (+ 1907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:40.296821 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:40.297892 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:40.298087 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:40.301739 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:40.301752 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:40.301776 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:40.301824 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:40.305499 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:40.306181 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:40.306187 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:40.306193 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:40.306357 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:40.306737 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:40.306742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:40.306745 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:40.307403 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:40.307679 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:40.307969 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 18:56:40.308368 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":364,"threads_started":1}
I20260809 18:56:40.316301 22580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5632bbb036bf4c91a2dd5e5152521d80" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43073 } }
I20260809 18:56:40.316643 22580 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:40.316720 22580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5632bbb036bf4c91a2dd5e5152521d80, State: Initialized, Role: FOLLOWER
I20260809 18:56:40.317207 22580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5632bbb036bf4c91a2dd5e5152521d80" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43073 } }
I20260809 18:56:40.317415 22580 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:40.317508 22580 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:40.317679 22580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:40.319798 22580 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5632bbb036bf4c91a2dd5e5152521d80" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43073 } }
I20260809 18:56:40.320215 22580 leader_election.cc:302] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5632bbb036bf4c91a2dd5e5152521d80; no voters:
I20260809 18:56:40.320688 22580 leader_election.cc:288] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:40.320787 22588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:40.321427 22588 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [term 1 LEADER]: Becoming Leader. State: Replica: 5632bbb036bf4c91a2dd5e5152521d80, State: Running, Role: LEADER
I20260809 18:56:40.321921 22588 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5632bbb036bf4c91a2dd5e5152521d80" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43073 } }
I20260809 18:56:40.322526 22580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:40.324455 22592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5632bbb036bf4c91a2dd5e5152521d80. Latest consensus state: current_term: 1 leader_uuid: "5632bbb036bf4c91a2dd5e5152521d80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5632bbb036bf4c91a2dd5e5152521d80" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43073 } } }
I20260809 18:56:40.324388 22591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5632bbb036bf4c91a2dd5e5152521d80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5632bbb036bf4c91a2dd5e5152521d80" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43073 } } }
I20260809 18:56:40.324833 22592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:40.324849 22591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:40.330056 22600 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:40.334272 22600 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:40.342808 22600 catalog_manager.cc:1347] Generated new cluster ID: 5fb35860739f4da5b5b4d4ddfd0acf60
I20260809 18:56:40.342919 22600 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:40.365160 22600 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:40.366972 22600 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:40.379621 22600 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5632bbb036bf4c91a2dd5e5152521d80: Generated new TSK 0
I20260809 18:56:40.380590 22600 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:40.426537 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43073
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:39797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:40.755162 22620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:40.755420 22620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:40.755556 22620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:40.762419 22620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:40.762516 22620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:40.762666 22620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:40.771834 22620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:40.772995 22620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:40.774220 22620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:40.786504 22626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:40.786453 22628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:40.786538 22630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:40.787348 22620 server_base.cc:1034] running on GCE node
I20260809 18:56:40.787885 22620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:40.788733 22620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:40.789919 22620 hybrid_clock.cc:648] HybridClock initialized: now 1786301800789871 us; error 42 us; skew 500 ppm
I20260809 18:56:40.790198 22620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:40 dist-test-slave-266d krb5kdc[22458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301800, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:40.793184 22620 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:40.794516 22620 webserver.cc:460] Webserver started at http://127.16.188.193:37161/ using document root <none> and password file <none>
I20260809 18:56:40.795118 22620 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:40.795221 22620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:40.795509 22620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:40.798233 22620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "48844b16666b43b797e484c37ce19a3e"
format_stamp: "Formatted at 2026-08-09 18:56:40 on dist-test-slave-266d"
server_key: "940e28250fe2556267e7a82915da70c2"
server_key_iv: "d458e704c74ab758663dc7e8424143d9"
server_key_version: "encryptionkey@0"
I20260809 18:56:40.798964 22620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "48844b16666b43b797e484c37ce19a3e"
format_stamp: "Formatted at 2026-08-09 18:56:40 on dist-test-slave-266d"
server_key: "940e28250fe2556267e7a82915da70c2"
server_key_iv: "d458e704c74ab758663dc7e8424143d9"
server_key_version: "encryptionkey@0"
I20260809 18:56:40.803637 22620 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 18:56:40.806730 22639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:40.807854 22620 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:56:40.808009 22620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "48844b16666b43b797e484c37ce19a3e"
format_stamp: "Formatted at 2026-08-09 18:56:40 on dist-test-slave-266d"
server_key: "940e28250fe2556267e7a82915da70c2"
server_key_iv: "d458e704c74ab758663dc7e8424143d9"
server_key_version: "encryptionkey@0"
I20260809 18:56:40.808202 22620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:40.834167 22620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:40.838126 22620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:40.838379 22620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:40.839232 22620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:40.840458 22620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:40.840528 22620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:40.840639 22620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:40.840690 22620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:40.872159 22620 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:41763
I20260809 18:56:40.872205 22803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:41763 every 8 connection(s)
I20260809 18:56:40.873407 22620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:40.875552 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 22620
I20260809 18:56:40.875741 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:40.876554 17139 external_mini_cluster.cc:1428] Setting key be24020f25c87f484dcd82033ff05ae8
Aug 09 18:56:40 dist-test-slave-266d krb5kdc[22458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301800, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:40.892263 22806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:40.875913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:50745 (local address 127.16.188.254:43073)
0809 18:56:40.876436 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:40.876443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:40.877426 (+ 983us) server_negotiation.cc:407] Connection header received
0809 18:56:40.879348 (+ 1922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:40.879357 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:40.879435 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:40.879530 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:40.880981 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:40.881708 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:40.883201 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:40.883614 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:40.883724 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:40.887064 (+ 3340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:40.887069 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:40.887073 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:40.887105 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:40.889466 (+ 2361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:40.890115 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:40.890119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:40.890122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:40.890241 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:40.890632 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:40.890637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:40.890640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:40.890897 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:40.891027 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:40.891690 (+ 663us) server_negotiation.cc:299] Negotiation successful
0809 18:56:40.891919 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":230,"threads_started":1}
I20260809 18:56:40.893167 22807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:40.876465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43073 (local address 127.16.188.193:50745)
0809 18:56:40.877266 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:40.877311 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:40.879083 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:40.879786 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:40.879794 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:40.880282 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:40.880812 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:40.880830 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:40.881859 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:40.881863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:40.883057 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:40.883074 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:40.883835 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:40.883844 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:40.884040 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:40.884635 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:40.884656 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:40.886868 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:40.889593 (+ 2725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:40.889601 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:40.889617 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:40.890005 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:40.890344 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:40.890349 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:40.890353 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:40.890528 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:40.891016 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:40.891023 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:40.891329 (+ 306us) client_negotiation.cc:769] Sending connection context
0809 18:56:40.891564 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 18:56:40.892043 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":324,"threads_started":1}
I20260809 18:56:40.894651 22804 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43073
I20260809 18:56:40.894939 22804 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:40.895591 22804 heartbeater.cc:511] Master 127.16.188.254:43073 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
I20260809 18:56:40.897639 22525 ts_manager.cc:194] Registered new tserver with Master: 48844b16666b43b797e484c37ce19a3e (127.16.188.193:41763)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
I20260809 18:56:40.899163 22525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:50745
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:40.921429 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43073
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:39797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:41.231947 22811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:41.232196 22811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:41.232326 22811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:41.239321 22811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:41.239428 22811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:41.239578 22811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:41.248922 22811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:41.250103 22811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:41.251365 22811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:41.263510 22822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:41.263589 22819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:41.263896 22818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:41.264382 22811 server_base.cc:1034] running on GCE node
I20260809 18:56:41.264901 22811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:41.265748 22811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:41.266937 22811 hybrid_clock.cc:648] HybridClock initialized: now 1786301801266891 us; error 37 us; skew 500 ppm
I20260809 18:56:41.267210 22811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:41 dist-test-slave-266d krb5kdc[22458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:41.270130 22811 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:41.271423 22811 webserver.cc:460] Webserver started at http://127.16.188.194:46851/ using document root <none> and password file <none>
I20260809 18:56:41.272014 22811 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:41.272117 22811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:41.272383 22811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:41.275056 22811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "34b70bd84112474ab3804b65e8d11e28"
format_stamp: "Formatted at 2026-08-09 18:56:41 on dist-test-slave-266d"
server_key: "7ecde87477575bf3739d0323f2b5f854"
server_key_iv: "a54ecef4b60f353efd9d9a2c1ff5f964"
server_key_version: "encryptionkey@0"
I20260809 18:56:41.275769 22811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "34b70bd84112474ab3804b65e8d11e28"
format_stamp: "Formatted at 2026-08-09 18:56:41 on dist-test-slave-266d"
server_key: "7ecde87477575bf3739d0323f2b5f854"
server_key_iv: "a54ecef4b60f353efd9d9a2c1ff5f964"
server_key_version: "encryptionkey@0"
I20260809 18:56:41.280537 22811 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 18:56:41.284399 22833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:41.285835 22811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:41.285992 22811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "34b70bd84112474ab3804b65e8d11e28"
format_stamp: "Formatted at 2026-08-09 18:56:41 on dist-test-slave-266d"
server_key: "7ecde87477575bf3739d0323f2b5f854"
server_key_iv: "a54ecef4b60f353efd9d9a2c1ff5f964"
server_key_version: "encryptionkey@0"
I20260809 18:56:41.286214 22811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:41.321614 22811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:41.325505 22811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:41.325738 22811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:41.326668 22811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:41.327970 22811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:41.328043 22811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:41.328154 22811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:41.328197 22811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:41.357766 22811 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:33051
I20260809 18:56:41.357818 22985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:33051 every 8 connection(s)
I20260809 18:56:41.359011 22811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:41.366282 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 22811
I20260809 18:56:41.366428 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:41.366847 17139 external_mini_cluster.cc:1428] Setting key 54e7c25e5d7d71d959b72909d89fd27e
Aug 09 18:56:41 dist-test-slave-266d krb5kdc[22458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:41.379472 22806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:41.361413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:50891 (local address 127.16.188.254:43073)
0809 18:56:41.361578 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:41.361582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:41.362733 (+ 1151us) server_negotiation.cc:407] Connection header received
0809 18:56:41.364490 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:41.364495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:41.364590 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:41.364680 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:41.366171 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.366979 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.368659 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.369070 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.369205 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:41.373124 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:41.373129 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:41.373133 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:41.373166 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:41.376361 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.377136 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.377141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.377145 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.377302 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.377741 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.377746 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.377749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.378108 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:41.378236 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:41.379052 (+ 816us) server_negotiation.cc:299] Negotiation successful
0809 18:56:41.379228 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 18:56:41.381206 22989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:41.361892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43073 (local address 127.16.188.194:50891)
0809 18:56:41.362575 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:41.362622 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:41.364225 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:41.364913 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:41.364921 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:41.365466 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:41.366003 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:41.366020 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.367119 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.367124 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:41.368534 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:41.368547 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.369326 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.369334 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:41.369616 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:41.370287 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:41.370322 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:41.372874 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:41.376530 (+ 3656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:41.376538 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:41.376550 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:41.376992 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:41.377407 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:41.377410 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:41.377412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:41.377636 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:41.378264 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:41.378273 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:41.378666 (+ 393us) client_negotiation.cc:769] Sending connection context
0809 18:56:41.378972 (+ 306us) client_negotiation.cc:240] Negotiation successful
0809 18:56:41.379459 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":285,"threads_started":1}
I20260809 18:56:41.382516 22986 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43073
I20260809 18:56:41.382838 22986 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:41.383530 22986 heartbeater.cc:511] Master 127.16.188.254:43073 requested a full tablet report, sending...
I20260809 18:56:41.384923 22525 ts_manager.cc:194] Registered new tserver with Master: 34b70bd84112474ab3804b65e8d11e28 (127.16.188.194:33051)
I20260809 18:56:41.385787 22525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:50891
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:56:41.412855 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43073
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:39797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:41.726155 22992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:41.726439 22992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:41.726588 22992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:41.733558 22992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:41.733664 22992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:41.733816 22992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:41.742947 22992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:43073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:41.744123 22992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:41.745357 22992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:41.757756 22999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:41.757731 23001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:41.757951 23004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:41.758674 22992 server_base.cc:1034] running on GCE node
I20260809 18:56:41.759224 22992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:41.760071 22992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:41.761263 22992 hybrid_clock.cc:648] HybridClock initialized: now 1786301801761216 us; error 29 us; skew 500 ppm
I20260809 18:56:41.761545 22992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:41 dist-test-slave-266d krb5kdc[22458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:41.764472 22992 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:41.765868 22992 webserver.cc:460] Webserver started at http://127.16.188.195:44175/ using document root <none> and password file <none>
I20260809 18:56:41.766481 22992 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:41.766588 22992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:41.766883 22992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:41.769706 22992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "73c8ce3fa2a348429c0c01c28dc7c8c5"
format_stamp: "Formatted at 2026-08-09 18:56:41 on dist-test-slave-266d"
server_key: "9de3362103b02e9f28513f7918a03d4f"
server_key_iv: "d867825b49a900a600b7a6356ab674c4"
server_key_version: "encryptionkey@0"
I20260809 18:56:41.770509 22992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "73c8ce3fa2a348429c0c01c28dc7c8c5"
format_stamp: "Formatted at 2026-08-09 18:56:41 on dist-test-slave-266d"
server_key: "9de3362103b02e9f28513f7918a03d4f"
server_key_iv: "d867825b49a900a600b7a6356ab674c4"
server_key_version: "encryptionkey@0"
I20260809 18:56:41.775274 22992 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 18:56:41.778462 23015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:41.779621 22992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:56:41.779776 22992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "73c8ce3fa2a348429c0c01c28dc7c8c5"
format_stamp: "Formatted at 2026-08-09 18:56:41 on dist-test-slave-266d"
server_key: "9de3362103b02e9f28513f7918a03d4f"
server_key_iv: "d867825b49a900a600b7a6356ab674c4"
server_key_version: "encryptionkey@0"
I20260809 18:56:41.779955 22992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:41.801268 22992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:41.805220 22992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:41.805472 22992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:41.806403 22992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:41.807678 22992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:41.807760 22992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:41.807879 22992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:41.807929 22992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:41.837616 22992 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:41723
I20260809 18:56:41.837690 23174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:41723 every 8 connection(s)
I20260809 18:56:41.839211 22992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:41.848496 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 22992
I20260809 18:56:41.848654 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:41.849076 17139 external_mini_cluster.cc:1428] Setting key b7c91c0b299a04b5027b1553328a1765
Aug 09 18:56:41 dist-test-slave-266d krb5kdc[22458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:41.859061 22806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:41.842268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:56779 (local address 127.16.188.254:43073)
0809 18:56:41.842462 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:41.842469 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:41.843954 (+ 1485us) server_negotiation.cc:407] Connection header received
0809 18:56:41.845953 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:41.845958 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:41.846035 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:41.846115 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:41.847457 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.848283 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.849969 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.850541 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.850663 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:41.854185 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:41.854190 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:41.854211 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:41.854252 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:41.856492 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.857169 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.857174 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.857176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.857296 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.857644 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.857647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.857649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.857904 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:41.858010 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:41.858548 (+ 538us) server_negotiation.cc:299] Negotiation successful
0809 18:56:41.858731 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:56:41.859838 23179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:41.842865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43073 (local address 127.16.188.195:56779)
0809 18:56:41.843745 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:41.843813 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:41.845676 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:41.846283 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:41.846291 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:41.846793 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:41.847320 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:41.847337 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.848422 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.848425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:41.849817 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:41.849832 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.850781 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.850789 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:41.851054 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:41.851728 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:41.851750 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:41.853994 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:41.856616 (+ 2622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:41.856623 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:41.856634 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:41.857026 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:41.857376 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:41.857379 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:41.857381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:41.857548 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:41.857990 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:41.857995 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:41.858264 (+ 269us) client_negotiation.cc:769] Sending connection context
0809 18:56:41.858468 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 18:56:41.858814 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":327,"threads_started":1}
I20260809 18:56:41.861126 23177 heartbeater.cc:347] Connected to a master server at 127.16.188.254:43073
I20260809 18:56:41.861388 23177 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:41.862025 23177 heartbeater.cc:511] Master 127.16.188.254:43073 requested a full tablet report, sending...
I20260809 18:56:41.863443 22525 ts_manager.cc:194] Registered new tserver with Master: 73c8ce3fa2a348429c0c01c28dc7c8c5 (127.16.188.195:41723)
I20260809 18:56:41.864390 22525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:56779
I20260809 18:56:41.864414 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:56:41 dist-test-slave-266d krb5kdc[22458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
I20260809 18:56:41.902374 22804 heartbeater.cc:503] Master 127.16.188.254:43073 was elected leader, sending a full tablet report...
Aug 09 18:56:41 dist-test-slave-266d krb5kdc[22458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:41.915719 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:41.901420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34852 (local address 127.16.188.193:41763)
0809 18:56:41.902001 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:41.902008 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:41.902036 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:56:41.902105 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:41.902111 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:41.902381 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:41.902531 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:41.904217 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.905247 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.906361 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.906875 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.906962 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:41.910493 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:41.910504 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:41.910518 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:41.910552 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:41.913376 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.914036 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.914042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.914045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.914163 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.914430 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.914433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.914435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.914745 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:41.914963 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:41.915169 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 18:56:41.915366 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"spinlock_wait_cycles":38656,"thread_start_us":304,"threads_started":1}
Aug 09 18:56:41 dist-test-slave-266d krb5kdc[22458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:41.932154 22806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:41.919661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33180 (local address 127.16.188.254:43073)
0809 18:56:41.919865 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:41.919870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:41.920011 (+ 141us) server_negotiation.cc:407] Connection header received
0809 18:56:41.920176 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:41.920181 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:41.920249 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:41.920332 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:41.921509 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.922221 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.923400 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.923827 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.923939 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:41.927496 (+ 3557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:41.927501 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:41.927504 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:41.927536 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:41.929793 (+ 2257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.930375 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.930380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.930384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.930512 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.930838 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.930843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.930846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.931140 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:41.931369 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:41.931673 (+ 304us) server_negotiation.cc:299] Negotiation successful
0809 18:56:41.931891 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 18:56:41.932646 22525 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33180
I20260809 18:56:41.933591 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 22620
I20260809 18:56:41.944985 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:41.934353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.16.188.193:41763)
0809 18:56:41.934562 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:41.934568 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:41.934779 (+ 211us) server_negotiation.cc:407] Connection header received
0809 18:56:41.934928 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:41.934933 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:41.934989 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:41.935063 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:41.936183 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.936853 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.938072 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:41.938473 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:41.938580 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:41.940537 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:41.940541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:41.940544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:41.940573 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:41.942762 (+ 2189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.943323 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.943328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.943331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.943443 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:41.943775 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:41.943780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:41.943784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:41.944015 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:41.944236 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:41.944504 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 18:56:41.944705 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:56:41.945541 22796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:42.025568 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 22620
I20260809 18:56:42.048564 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 22811
Aug 09 18:56:42 dist-test-slave-266d krb5kdc[22458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:56:42.063650 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.049544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43674 (local address 127.16.188.194:33051)
0809 18:56:42.050084 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:42.050091 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:42.050117 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:56:42.050185 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:42.050191 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:42.050398 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:42.050527 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:42.051675 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.052699 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.054097 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.054651 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.054748 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.058563 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:42.058575 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:42.058589 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:42.058622 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:42.061417 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.061956 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.061963 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.061965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.062086 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.062364 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.062367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.062369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.062684 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:42.062905 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:42.063094 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 18:56:42.063284 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":262,"threads_started":1}
I20260809 18:56:42.064858 22979 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:42.145365 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 22811
I20260809 18:56:42.172325 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 22992
Aug 09 18:56:42 dist-test-slave-266d krb5kdc[22458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:56:42.188493 23199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:42.173386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59358 (local address 127.16.188.195:41723)
0809 18:56:42.174020 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:42.174027 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:42.174056 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:56:42.174127 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:42.174133 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:42.174341 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:42.174485 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:42.175754 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.176813 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.178232 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:42.178796 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:42.178914 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:42.183032 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:42.183043 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:42.183057 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:42.183097 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:42.185782 (+ 2685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.186407 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.186414 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.186416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.186556 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:42.186916 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:42.186920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:42.186922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:42.187276 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:42.187578 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:42.187914 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 18:56:42.188185 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":312,"threads_started":1}
I20260809 18:56:42.189746 23167 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:42.271008 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 22992
I20260809 18:56:42.295933 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 22473
I20260809 18:56:42.297103 22572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:42.397660 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 22473
2026-08-09T18:56:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3900 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:42 dist-test-slave-266d krb5kdc[23209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:42 dist-test-slave-266d krb5kdc[23209](info): set up 2 sockets
Aug 09 18:56:42 dist-test-slave-266d krb5kdc[23209](info): commencing operation
krb5kdc: starting...
W20260809 18:56:43.593241 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.004s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:43 dist-test-slave-266d krb5kdc[23209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:43.784314 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:35381
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:37911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:35381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:44.101723 23230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:44.102036 23230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:44.102181 23230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:44.109254 23230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:44.109368 23230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:44.109447 23230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:44.109527 23230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:44.109593 23230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:44.119177 23230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:35381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:35381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:44.120373 23230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:44.121626 23230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:44.132719 23236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:44.132756 23238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:44.132824 23240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:44.133412 23230 server_base.cc:1034] running on GCE node
I20260809 18:56:44.134074 23230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:44.135270 23230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:44.136461 23230 hybrid_clock.cc:648] HybridClock initialized: now 1786301804136412 us; error 37 us; skew 500 ppm
I20260809 18:56:44.136838 23230 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:44 dist-test-slave-266d krb5kdc[23209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301804, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:44.139703 23230 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:44.140746 23230 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:44.140836 23230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:44.141114 23230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:44.143858 23230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "0ff068ec68c4480b88928e7e668106f0"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-266d"
server_key: "a3a57fc8af2aa68349c34859a5d847df"
server_key_iv: "deb7c0163535a86785ad332de1505fde"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.144582 23230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "0ff068ec68c4480b88928e7e668106f0"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-266d"
server_key: "a3a57fc8af2aa68349c34859a5d847df"
server_key_iv: "deb7c0163535a86785ad332de1505fde"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.149147 23230 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260809 18:56:44.152204 23251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:44.153398 23230 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 18:56:44.153540 23230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "0ff068ec68c4480b88928e7e668106f0"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-266d"
server_key: "a3a57fc8af2aa68349c34859a5d847df"
server_key_iv: "deb7c0163535a86785ad332de1505fde"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.153708 23230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:44.166406 23230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:44.170238 23230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:44.170450 23230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:44.187057 23230 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:35381
I20260809 18:56:44.187091 23342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:35381 every 8 connection(s)
I20260809 18:56:44.187858 23230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:44.190140 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 23230
I20260809 18:56:44.190361 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:44.191309 17139 external_mini_cluster.cc:1428] Setting key 898f55e285008ca963e962738ff26df5
I20260809 18:56:44.192174 23343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 18:56:44 dist-test-slave-266d krb5kdc[23209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:44.207031 23343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0: Bootstrap starting.
I20260809 18:56:44.210572 23343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:44.211851 23343 log.cc:824] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:44.214699 23347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:44.193447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38066 (local address 127.16.188.254:35381)
0809 18:56:44.194191 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:44.194202 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:44.194241 (+ 39us) server_negotiation.cc:407] Connection header received
0809 18:56:44.195680 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:44.195699 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:44.196075 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:44.196386 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:44.198405 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.199700 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.201571 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.202199 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.202317 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:44.207326 (+ 5009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:44.207334 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:44.207347 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:44.207382 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:44.210248 (+ 2866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:44.211055 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:44.211061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:44.211067 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:44.211236 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:44.211656 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:44.211659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:44.211661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:44.212205 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:44.212479 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:44.213029 (+ 550us) server_negotiation.cc:299] Negotiation successful
0809 18:56:44.213470 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":360,"threads_started":1}
I20260809 18:56:44.215058 23343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0: No bootstrap required, opened a new log
I20260809 18:56:44.222437 23343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff068ec68c4480b88928e7e668106f0" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35381 } }
I20260809 18:56:44.222751 23343 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:44.222829 23343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ff068ec68c4480b88928e7e668106f0, State: Initialized, Role: FOLLOWER
I20260809 18:56:44.223290 23343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff068ec68c4480b88928e7e668106f0" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35381 } }
I20260809 18:56:44.223562 23343 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:44.223695 23343 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:44.223869 23343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:44.226428 23343 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff068ec68c4480b88928e7e668106f0" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35381 } }
I20260809 18:56:44.226888 23343 leader_election.cc:302] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ff068ec68c4480b88928e7e668106f0; no voters:
I20260809 18:56:44.227418 23343 leader_election.cc:288] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:44.227528 23349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:44.228220 23349 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [term 1 LEADER]: Becoming Leader. State: Replica: 0ff068ec68c4480b88928e7e668106f0, State: Running, Role: LEADER
I20260809 18:56:44.229060 23349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff068ec68c4480b88928e7e668106f0" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35381 } }
I20260809 18:56:44.229598 23343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:44.231778 23350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ff068ec68c4480b88928e7e668106f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff068ec68c4480b88928e7e668106f0" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35381 } } }
I20260809 18:56:44.232128 23350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:44.231953 23352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ff068ec68c4480b88928e7e668106f0. Latest consensus state: current_term: 1 leader_uuid: "0ff068ec68c4480b88928e7e668106f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff068ec68c4480b88928e7e668106f0" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35381 } } }
I20260809 18:56:44.232280 23352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:44.233628 23363 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:44.238587 23363 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:44.246798 23363 catalog_manager.cc:1347] Generated new cluster ID: c9391ef639c04c98b8d7bd021ccf0562
I20260809 18:56:44.246904 23363 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:44.276516 23363 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:44.277973 23363 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:44.286257 23363 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0: Generated new TSK 0
I20260809 18:56:44.287279 23363 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:44.343082 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35381
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:37911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:44.659718 23381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:44.659982 23381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:44.660102 23381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:44.667064 23381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:44.667156 23381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:44.667305 23381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:44.677753 23381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:44.678952 23381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:44.680169 23381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:44.692041 23394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:44.692121 23392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:44.692159 23397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:44.692624 23381 server_base.cc:1034] running on GCE node
I20260809 18:56:44.693349 23381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:44.694205 23381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:44.695401 23381 hybrid_clock.cc:648] HybridClock initialized: now 1786301804695362 us; error 27 us; skew 500 ppm
I20260809 18:56:44.695693 23381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:44 dist-test-slave-266d krb5kdc[23209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301804, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:44.698653 23381 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:44.699688 23381 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:44.699791 23381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:44.700095 23381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:44.702893 23381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "44256922445047f8afe190892c704573"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-266d"
server_key: "c7f94fbfa8d0cfb064b830dd6dabb76b"
server_key_iv: "8d56378a85089f1607da187349d65e53"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.703656 23381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "44256922445047f8afe190892c704573"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-266d"
server_key: "c7f94fbfa8d0cfb064b830dd6dabb76b"
server_key_iv: "8d56378a85089f1607da187349d65e53"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.708335 23381 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 18:56:44.711547 23407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:44.712726 23381 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:56:44.712878 23381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "44256922445047f8afe190892c704573"
format_stamp: "Formatted at 2026-08-09 18:56:44 on dist-test-slave-266d"
server_key: "c7f94fbfa8d0cfb064b830dd6dabb76b"
server_key_iv: "8d56378a85089f1607da187349d65e53"
server_key_version: "encryptionkey@0"
I20260809 18:56:44.713081 23381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:44.724100 23381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:44.727568 23381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:44.727787 23381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:44.728622 23381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:44.729907 23381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:44.729991 23381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:44.730095 23381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:44.730171 23381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:44.758952 23381 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:41947
I20260809 18:56:44.759011 23583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:41947 every 8 connection(s)
I20260809 18:56:44.759723 23381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:44.762073 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 23381
I20260809 18:56:44.762302 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:44.763031 17139 external_mini_cluster.cc:1428] Setting key edd3659582fae59a4e921af747819d41
Aug 09 18:56:44 dist-test-slave-266d krb5kdc[23209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301804, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:44.779572 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:44.761915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:34327 (local address 127.16.188.254:35381)
0809 18:56:44.762430 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:44.762437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:44.763381 (+ 944us) server_negotiation.cc:407] Connection header received
0809 18:56:44.765756 (+ 2375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:44.765762 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:44.765844 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:44.765948 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:44.767428 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.768332 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.769994 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.770545 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.770681 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:44.773946 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:44.773951 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:44.773954 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:44.773986 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:44.776318 (+ 2332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:44.776993 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:44.776999 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:44.777002 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:44.777155 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:44.777556 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:44.777561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:44.777565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:44.777877 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:44.778010 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:44.778753 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 18:56:44.779108 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":275,"threads_started":1}
I20260809 18:56:44.780229 23590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:44.762413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35381 (local address 127.16.188.193:34327)
0809 18:56:44.763209 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:44.763261 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:44.765453 (+ 2192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:44.766154 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:44.766162 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:44.766694 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:44.767238 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:44.767256 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.768491 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.768496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:44.769841 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:44.769855 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:44.770781 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:44.770787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:44.770978 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:44.771574 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:44.771601 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:44.773730 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:44.776447 (+ 2717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:44.776456 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:44.776470 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:44.776871 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:44.777260 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:44.777265 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:44.777269 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:44.777445 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:44.778001 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:44.778008 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:44.778313 (+ 305us) client_negotiation.cc:769] Sending connection context
0809 18:56:44.778579 (+ 266us) client_negotiation.cc:240] Negotiation successful
0809 18:56:44.779090 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":296,"threads_started":1}
I20260809 18:56:44.781883 23585 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35381
I20260809 18:56:44.782174 23585 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:44.782797 23585 heartbeater.cc:511] Master 127.16.188.254:35381 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
I20260809 18:56:44.784811 23285 ts_manager.cc:194] Registered new tserver with Master: 44256922445047f8afe190892c704573 (127.16.188.193:41947)
I20260809 18:56:44.786300 23285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:34327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:44.808194 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35381
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:37911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:45.122411 23599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:45.122663 23599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:45.122759 23599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:45.129863 23599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:45.129954 23599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:45.130095 23599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:45.139511 23599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:45.140656 23599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:45.141894 23599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:45.153524 23606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:45.153689 23613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:45.153775 23607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:45.154613 23599 server_base.cc:1034] running on GCE node
I20260809 18:56:45.155124 23599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:45.155989 23599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:45.157178 23599 hybrid_clock.cc:648] HybridClock initialized: now 1786301805157123 us; error 48 us; skew 500 ppm
I20260809 18:56:45.157482 23599 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:45 dist-test-slave-266d krb5kdc[23209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301805, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:45.160429 23599 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:45.161541 23599 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:45.161643 23599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:45.161928 23599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:45.164696 23599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f"
format_stamp: "Formatted at 2026-08-09 18:56:45 on dist-test-slave-266d"
server_key: "ef8871e27fa9e8b92d411e10c7c6ed32"
server_key_iv: "4e870d03ae432920401779462b18eaf5"
server_key_version: "encryptionkey@0"
I20260809 18:56:45.165486 23599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f"
format_stamp: "Formatted at 2026-08-09 18:56:45 on dist-test-slave-266d"
server_key: "ef8871e27fa9e8b92d411e10c7c6ed32"
server_key_iv: "4e870d03ae432920401779462b18eaf5"
server_key_version: "encryptionkey@0"
I20260809 18:56:45.170056 23599 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 18:56:45.173216 23624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:45.174383 23599 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 18:56:45.174522 23599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f"
format_stamp: "Formatted at 2026-08-09 18:56:45 on dist-test-slave-266d"
server_key: "ef8871e27fa9e8b92d411e10c7c6ed32"
server_key_iv: "4e870d03ae432920401779462b18eaf5"
server_key_version: "encryptionkey@0"
I20260809 18:56:45.174705 23599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:45.193766 23599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:45.197607 23599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:45.197849 23599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:45.198706 23599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:45.200006 23599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:45.200098 23599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:45.200202 23599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:45.200276 23599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:45.229534 23599 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:41239
I20260809 18:56:45.229596 23811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:41239 every 8 connection(s)
I20260809 18:56:45.230382 23599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:45.235626 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 23599
I20260809 18:56:45.235860 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:45.236435 17139 external_mini_cluster.cc:1428] Setting key c5a25bc85583c293076b343aedecc718
Aug 09 18:56:45 dist-test-slave-266d krb5kdc[23209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301805, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:45.254227 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.232635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:34397 (local address 127.16.188.254:35381)
0809 18:56:45.232857 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.232864 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.233985 (+ 1121us) server_negotiation.cc:407] Connection header received
0809 18:56:45.235858 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.235863 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.235941 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.236037 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:45.237770 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.238803 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.240919 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.241362 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.241459 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.248775 (+ 7316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:45.248780 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:45.248783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:45.248815 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:45.251269 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:45.252127 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:45.252131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:45.252133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:45.252257 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:45.252656 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:45.252659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:45.252661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:45.252892 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:45.252993 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.253804 (+ 811us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.253966 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":59}
I20260809 18:56:45.255558 23814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.233160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35381 (local address 127.16.188.194:34397)
0809 18:56:45.233854 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:45.233890 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:45.235590 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:45.236296 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:45.236320 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:45.237010 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:45.237612 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.237630 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.238950 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.238956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.240783 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.240799 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.241568 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.241575 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.241818 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.246033 (+ 4215us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:45.246060 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:45.248571 (+ 2511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:45.251398 (+ 2827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:45.251407 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:45.251421 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:45.252022 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:45.252355 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:45.252359 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:45.252363 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:45.252568 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:45.253021 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:45.253029 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:45.253432 (+ 403us) client_negotiation.cc:769] Sending connection context
0809 18:56:45.253712 (+ 280us) client_negotiation.cc:240] Negotiation successful
0809 18:56:45.254220 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":266,"threads_started":1}
I20260809 18:56:45.256980 23812 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35381
I20260809 18:56:45.257326 23812 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:45.257987 23812 heartbeater.cc:511] Master 127.16.188.254:35381 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
I20260809 18:56:45.259402 23285 ts_manager.cc:194] Registered new tserver with Master: 14fc7b3c901442d6a7ab7f83e8d7f43f (127.16.188.194:41239)
I20260809 18:56:45.260236 23285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:34397
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:56:45.284054 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35381
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:37911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:45.599267 23818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:45.599516 23818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:45.599656 23818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:45.606611 23818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:45.606709 23818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:45.606879 23818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:45.616058 23818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:45.617273 23818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:45.618494 23818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:45.630451 23829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:45.630489 23827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:45.630414 23826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:45.631819 23818 server_base.cc:1034] running on GCE node
I20260809 18:56:45.632334 23818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:45.633213 23818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:45.634402 23818 hybrid_clock.cc:648] HybridClock initialized: now 1786301805634348 us; error 48 us; skew 500 ppm
I20260809 18:56:45.634692 23818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:45 dist-test-slave-266d krb5kdc[23209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301805, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:45.637590 23818 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:45.638687 23818 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:45.638773 23818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:45.639024 23818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:45.641821 23818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "e3124622d5d54e5884e2446bc36facb8"
format_stamp: "Formatted at 2026-08-09 18:56:45 on dist-test-slave-266d"
server_key: "91cbeca80bb25e47c864f6ab5bd92f63"
server_key_iv: "11432717824075ed8e137f38faf5c926"
server_key_version: "encryptionkey@0"
I20260809 18:56:45.642566 23818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "e3124622d5d54e5884e2446bc36facb8"
format_stamp: "Formatted at 2026-08-09 18:56:45 on dist-test-slave-266d"
server_key: "91cbeca80bb25e47c864f6ab5bd92f63"
server_key_iv: "11432717824075ed8e137f38faf5c926"
server_key_version: "encryptionkey@0"
I20260809 18:56:45.647333 23818 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 18:56:45.650532 23838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:45.651743 23818 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 18:56:45.651880 23818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "e3124622d5d54e5884e2446bc36facb8"
format_stamp: "Formatted at 2026-08-09 18:56:45 on dist-test-slave-266d"
server_key: "91cbeca80bb25e47c864f6ab5bd92f63"
server_key_iv: "11432717824075ed8e137f38faf5c926"
server_key_version: "encryptionkey@0"
I20260809 18:56:45.652064 23818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:45.673015 23818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:45.677264 23818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:45.677632 23818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:45.678808 23818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:45.680433 23818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:45.680519 23818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:45.680630 23818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:45.680691 23818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:45.708717 23818 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:45237
I20260809 18:56:45.708777 23996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:45237 every 8 connection(s)
I20260809 18:56:45.709546 23818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:45.710469 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 23818
I20260809 18:56:45.710664 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:45.711215 17139 external_mini_cluster.cc:1428] Setting key bbe1c6822198746de24edc8171f30549
Aug 09 18:56:45 dist-test-slave-266d krb5kdc[23209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301805, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:45.728374 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.712429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:60565 (local address 127.16.188.254:35381)
0809 18:56:45.712586 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.712590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.713663 (+ 1073us) server_negotiation.cc:407] Connection header received
0809 18:56:45.715517 (+ 1854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.715522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.715628 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.715711 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:45.717142 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.717875 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.719347 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.719742 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.719848 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.722968 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:45.722973 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:45.722976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:45.723007 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:45.725536 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:45.726294 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:45.726300 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:45.726304 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:45.726426 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:45.726801 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:45.726805 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:45.726809 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:45.727076 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:45.727212 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.727811 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.728024 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:56:45.729240 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.712744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35381 (local address 127.16.188.195:60565)
0809 18:56:45.713532 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:45.713575 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:45.715279 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:45.715939 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:45.715947 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:45.716433 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:45.716967 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.716984 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.718021 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.718025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.719213 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.719226 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.719947 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.719954 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.720169 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.720705 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:45.720726 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:45.722790 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:45.725674 (+ 2884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:45.725682 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:45.725693 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:45.726183 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:45.726526 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:45.726531 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:45.726535 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:45.726699 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:45.727196 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:45.727204 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:45.727492 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 18:56:45.727712 (+ 220us) client_negotiation.cc:240] Negotiation successful
0809 18:56:45.728176 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":321,"threads_started":1}
I20260809 18:56:45.730547 23998 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35381
I20260809 18:56:45.730806 23998 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:45.731387 23998 heartbeater.cc:511] Master 127.16.188.254:35381 requested a full tablet report, sending...
I20260809 18:56:45.732709 23285 ts_manager.cc:194] Registered new tserver with Master: e3124622d5d54e5884e2446bc36facb8 (127.16.188.195:45237)
I20260809 18:56:45.733546 23285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:60565
I20260809 18:56:45.738359 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:56:45.753441 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.742632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38070 (local address 127.16.188.254:35381)
0809 18:56:45.742806 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.742812 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.743239 (+ 427us) server_negotiation.cc:407] Connection header received
0809 18:56:45.743360 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.743364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.743417 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.743485 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:45.744786 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.745506 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.746683 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.747097 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.747181 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.749228 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:45.749232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:45.749235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:45.749259 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:45.751356 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:45.751930 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:45.751934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:45.751936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:45.752042 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:45.752304 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:45.752307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:45.752309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:45.752587 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:45.752755 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.752987 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.753174 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:56:45.757167 23285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:45.763859 23285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:45.785866 24027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.774860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59878 (local address 127.16.188.193:41947)
0809 18:56:45.775462 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.775471 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.776366 (+ 895us) server_negotiation.cc:407] Connection header received
0809 18:56:45.776743 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.776752 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.776999 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.777188 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:45.778209 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.779913 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.782742 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.784222 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.784390 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.784558 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.785309 (+ 751us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.785507 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":308,"threads_started":1}
I20260809 18:56:45.786687 24033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.774584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:41947 (local address 127.0.0.1:59878)
0809 18:56:45.776205 (+ 1621us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:45.776242 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:45.776501 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:45.777505 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:45.777513 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:45.777544 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:45.777999 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.778013 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.780146 (+ 2133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.780152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.782554 (+ 2402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.782571 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.784769 (+ 2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.784776 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.785006 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.785059 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 18:56:45.786081 (+ 1022us) client_negotiation.cc:240] Negotiation successful
0809 18:56:45.786307 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1365,"thread_start_us":1431,"threads_started":1}
I20260809 18:56:45.789443 23585 heartbeater.cc:503] Master 127.16.188.254:35381 was elected leader, sending a full tablet report...
I20260809 18:56:45.790665 23481 tablet_service.cc:1467] Processing CreateTablet for tablet 152d22e977a64a9fbdd1dfe6fdf8a091 (DEFAULT_TABLE table=test-table [id=eb9463422e46490ea111a42c81391bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:45.792201 23481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152d22e977a64a9fbdd1dfe6fdf8a091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:45.794158 24033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.775855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:41239 (local address 127.0.0.1:56878)
0809 18:56:45.786888 (+ 11033us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:45.786903 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:45.786987 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:45.788242 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:45.788247 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:45.788272 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:45.788425 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.788435 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.790449 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.790454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.792183 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.792194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.793469 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.793475 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.793655 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.793687 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 18:56:45.793770 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:56:45.793902 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10947,"thread_start_us":8675,"threads_started":1}
I20260809 18:56:45.794288 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.775120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56878 (local address 127.16.188.194:41239)
0809 18:56:45.787746 (+ 12626us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.787754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.787788 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:56:45.787869 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.787875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.788047 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.788594 (+ 547us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:45.788830 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.790273 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.792369 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.793320 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.793464 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.793643 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.793830 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.793980 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12479,"thread_start_us":11821,"threads_started":1}
I20260809 18:56:45.796236 24036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.775171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:45237 (local address 127.0.0.1:55550)
0809 18:56:45.784861 (+ 9690us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:45.784885 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:45.785007 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:45.788593 (+ 3586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:45.788597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:45.788618 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:45.788990 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.789001 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.791467 (+ 2466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.791472 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.793510 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.793531 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.795522 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.795529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.795692 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.795721 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 18:56:45.795798 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:56:45.795913 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9540,"thread_start_us":12164,"threads_started":1}
I20260809 18:56:45.797024 24035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.775665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55550 (local address 127.16.188.195:45237)
0809 18:56:45.787647 (+ 11982us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.787655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.787688 (+ 33us) server_negotiation.cc:407] Connection header received
0809 18:56:45.787783 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.787790 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.788008 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.788304 (+ 296us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:45.789229 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.791295 (+ 2066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.793703 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.795045 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.795241 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.795391 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.796529 (+ 1138us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.796691 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11825,"thread_start_us":11651,"threads_started":1}
I20260809 18:56:45.797955 23701 tablet_service.cc:1467] Processing CreateTablet for tablet 152d22e977a64a9fbdd1dfe6fdf8a091 (DEFAULT_TABLE table=test-table [id=eb9463422e46490ea111a42c81391bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:45.799381 23701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152d22e977a64a9fbdd1dfe6fdf8a091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:45.800590 23902 tablet_service.cc:1467] Processing CreateTablet for tablet 152d22e977a64a9fbdd1dfe6fdf8a091 (DEFAULT_TABLE table=test-table [id=eb9463422e46490ea111a42c81391bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:45.801890 23902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152d22e977a64a9fbdd1dfe6fdf8a091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:45.805648 24037 tablet_bootstrap.cc:492] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: Bootstrap starting.
I20260809 18:56:45.808517 24037 tablet_bootstrap.cc:654] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:45.809520 24037 log.cc:824] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:45.812758 24037 tablet_bootstrap.cc:492] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: No bootstrap required, opened a new log
I20260809 18:56:45.813030 24037 ts_tablet_manager.cc:1397] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 18:56:45.813509 24039 tablet_bootstrap.cc:492] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: Bootstrap starting.
I20260809 18:56:45.815388 24040 tablet_bootstrap.cc:492] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: Bootstrap starting.
I20260809 18:56:45.817308 24039 tablet_bootstrap.cc:654] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:45.818292 24040 tablet_bootstrap.cc:654] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:45.818867 24039 log.cc:824] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:45.819213 24040 log.cc:824] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:45.821786 24040 tablet_bootstrap.cc:492] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: No bootstrap required, opened a new log
I20260809 18:56:45.822024 24040 ts_tablet_manager.cc:1397] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 18:56:45.823516 24039 tablet_bootstrap.cc:492] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: No bootstrap required, opened a new log
I20260809 18:56:45.823247 24037 raft_consensus.cc:348] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.823652 24037 raft_consensus.cc:374] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:45.823753 24037 raft_consensus.cc:729] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44256922445047f8afe190892c704573, State: Initialized, Role: FOLLOWER
I20260809 18:56:45.823793 24039 ts_tablet_manager.cc:1397] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260809 18:56:45.824373 24037 consensus_queue.cc:260] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.829454 24040 raft_consensus.cc:348] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.829845 24040 raft_consensus.cc:374] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:45.829939 24040 raft_consensus.cc:729] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3124622d5d54e5884e2446bc36facb8, State: Initialized, Role: FOLLOWER
I20260809 18:56:45.830510 24037 ts_tablet_manager.cc:1428] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: Time spent starting tablet: real 0.017s user 0.011s sys 0.006s
I20260809 18:56:45.830564 24040 consensus_queue.cc:260] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.831585 23998 heartbeater.cc:503] Master 127.16.188.254:35381 was elected leader, sending a full tablet report...
I20260809 18:56:45.832162 24040 ts_tablet_manager.cc:1428] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: Time spent starting tablet: real 0.010s user 0.006s sys 0.004s
I20260809 18:56:45.834307 24039 raft_consensus.cc:348] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.834719 24039 raft_consensus.cc:374] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:45.834827 24039 raft_consensus.cc:729] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fc7b3c901442d6a7ab7f83e8d7f43f, State: Initialized, Role: FOLLOWER
I20260809 18:56:45.835348 24039 consensus_queue.cc:260] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.836371 23812 heartbeater.cc:503] Master 127.16.188.254:35381 was elected leader, sending a full tablet report...
I20260809 18:56:45.837898 24039 ts_tablet_manager.cc:1428] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260809 18:56:45.868897 24046 raft_consensus.cc:482] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:45.869160 24046 raft_consensus.cc:504] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.870699 24046 leader_election.cc:288] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44256922445047f8afe190892c704573 (127.16.188.193:41947), 14fc7b3c901442d6a7ab7f83e8d7f43f (127.16.188.194:41239)
I20260809 18:56:45.875921 24027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.870983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:56281 (local address 127.16.188.193:41947)
0809 18:56:45.871255 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.871262 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.871281 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:56:45.871455 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.871459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.871518 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.871592 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:45.872036 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.872726 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.874314 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.875046 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.875184 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.875259 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.875548 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.875672 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260809 18:56:45.875916 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.870857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:41947 (local address 127.16.188.195:56281)
0809 18:56:45.871161 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:45.871181 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:45.871313 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:45.871641 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:45.871650 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:45.871678 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:45.871856 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.871865 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.872875 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.872879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.874165 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.874177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.875183 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.875190 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.875388 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.875422 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 18:56:45.875508 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 18:56:45.875648 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152}
I20260809 18:56:45.876889 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.871114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:60313 (local address 127.16.188.194:41239)
0809 18:56:45.871308 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.871314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.871957 (+ 643us) server_negotiation.cc:407] Connection header received
0809 18:56:45.872108 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.872112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.872169 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.872242 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:56:45.872747 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.873479 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.875077 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.875929 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.876066 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.876146 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.876526 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.876649 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 18:56:45.876920 24048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.871146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:41239 (local address 127.16.188.195:60313)
0809 18:56:45.871856 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:45.871870 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:45.871968 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:45.872268 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:45.872272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:45.872295 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:56:45.872587 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.872596 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.873632 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.873635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.874937 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:45.874948 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.876238 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.876242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:45.876378 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.876401 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 18:56:45.876479 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:56:45.876595 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":389,"threads_started":1}
I20260809 18:56:45.876884 23509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152d22e977a64a9fbdd1dfe6fdf8a091" candidate_uuid: "e3124622d5d54e5884e2446bc36facb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44256922445047f8afe190892c704573" is_pre_election: true
I20260809 18:56:45.877456 23509 raft_consensus.cc:2454] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3124622d5d54e5884e2446bc36facb8 in term 0.
I20260809 18:56:45.877919 23743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152d22e977a64a9fbdd1dfe6fdf8a091" candidate_uuid: "e3124622d5d54e5884e2446bc36facb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" is_pre_election: true
I20260809 18:56:45.878090 23839 leader_election.cc:302] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44256922445047f8afe190892c704573, e3124622d5d54e5884e2446bc36facb8; no voters:
I20260809 18:56:45.878481 24046 raft_consensus.cc:2781] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:45.878461 23743 raft_consensus.cc:2454] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3124622d5d54e5884e2446bc36facb8 in term 0.
I20260809 18:56:45.878638 24046 raft_consensus.cc:482] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:45.878744 24046 raft_consensus.cc:3037] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:45.880985 24046 raft_consensus.cc:504] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.881563 24046 leader_election.cc:288] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [CANDIDATE]: Term 1 election: Requested vote from peers 44256922445047f8afe190892c704573 (127.16.188.193:41947), 14fc7b3c901442d6a7ab7f83e8d7f43f (127.16.188.194:41239)
I20260809 18:56:45.881965 23509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152d22e977a64a9fbdd1dfe6fdf8a091" candidate_uuid: "e3124622d5d54e5884e2446bc36facb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44256922445047f8afe190892c704573"
I20260809 18:56:45.881970 23743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152d22e977a64a9fbdd1dfe6fdf8a091" candidate_uuid: "e3124622d5d54e5884e2446bc36facb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f"
I20260809 18:56:45.882131 23743 raft_consensus.cc:3037] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:45.882131 23509 raft_consensus.cc:3037] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:45.884621 23509 raft_consensus.cc:2454] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3124622d5d54e5884e2446bc36facb8 in term 1.
I20260809 18:56:45.884768 23743 raft_consensus.cc:2454] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3124622d5d54e5884e2446bc36facb8 in term 1.
I20260809 18:56:45.884970 23839 leader_election.cc:302] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44256922445047f8afe190892c704573, e3124622d5d54e5884e2446bc36facb8; no voters:
I20260809 18:56:45.885269 24046 raft_consensus.cc:2781] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:45.885723 24046 raft_consensus.cc:686] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 1 LEADER]: Becoming Leader. State: Replica: e3124622d5d54e5884e2446bc36facb8, State: Running, Role: LEADER
I20260809 18:56:45.886168 24046 consensus_queue.cc:237] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } }
I20260809 18:56:45.890501 23283 catalog_manager.cc:5495] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3124622d5d54e5884e2446bc36facb8 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "e3124622d5d54e5884e2446bc36facb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3124622d5d54e5884e2446bc36facb8" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 45237 } health_report { overall_health: HEALTHY } } }
I20260809 18:56:45.920334 24035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.915264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55552 (local address 127.16.188.195:45237)
0809 18:56:45.915456 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.915462 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.915591 (+ 129us) server_negotiation.cc:407] Connection header received
0809 18:56:45.915802 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.915806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.915877 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.915997 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:56:45.916362 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.917127 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.918413 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.918790 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.918895 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.919345 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:56:45.919793 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:56:45.919934 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.920011 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.920087 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 18:56:45.928290 23509 raft_consensus.cc:1261] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 1 FOLLOWER]: Refusing update from remote peer e3124622d5d54e5884e2446bc36facb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:45.928290 23743 raft_consensus.cc:1261] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 1 FOLLOWER]: Refusing update from remote peer e3124622d5d54e5884e2446bc36facb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:45.929363 24046 consensus_queue.cc:1035] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14fc7b3c901442d6a7ab7f83e8d7f43f" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:45.929648 24050 consensus_queue.cc:1035] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44256922445047f8afe190892c704573" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:45.940526 24057 mvcc.cc:205] Tried to move back new op lower bound from 7316692197071745024 to 7316692196913168384. Current Snapshot: MvccSnapshot[applied={T|T < 7316692197071745024}]
I20260809 18:56:45.952757 23283 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:45.953015 23283 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:45.956255 23283 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ff068ec68c4480b88928e7e668106f0: Sending DeleteTablet for 3 replicas of tablet 152d22e977a64a9fbdd1dfe6fdf8a091
I20260809 18:56:45.957381 23481 tablet_service.cc:1514] Processing DeleteTablet for tablet 152d22e977a64a9fbdd1dfe6fdf8a091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:45 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:59878
I20260809 18:56:45.957442 23701 tablet_service.cc:1514] Processing DeleteTablet for tablet 152d22e977a64a9fbdd1dfe6fdf8a091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:45 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:56878
I20260809 18:56:45.957746 23902 tablet_service.cc:1514] Processing DeleteTablet for tablet 152d22e977a64a9fbdd1dfe6fdf8a091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:45 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:55550
I20260809 18:56:45.959168 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 23381
I20260809 18:56:45.969748 24069 tablet_replica.cc:330] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: stopping tablet replica
I20260809 18:56:45.970167 24069 raft_consensus.cc:2229] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:45.970798 24069 raft_consensus.cc:2258] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:45.972890 24069 ts_tablet_manager.cc:1905] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:45.973599 24066 tablet_replica.cc:330] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: stopping tablet replica
I20260809 18:56:45.973906 24066 raft_consensus.cc:2229] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:45.974403 24066 raft_consensus.cc:2258] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:45.976114 24066 ts_tablet_manager.cc:1905] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:45.980245 24069 ts_tablet_manager.cc:1918] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:45.980446 24069 log.cc:1196] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/152d22e977a64a9fbdd1dfe6fdf8a091
I20260809 18:56:45.981168 24069 ts_tablet_manager.cc:1939] T 152d22e977a64a9fbdd1dfe6fdf8a091 P e3124622d5d54e5884e2446bc36facb8: Deleting consensus metadata
Aug 09 18:56:45 dist-test-slave-266d krb5kdc[23209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:45.984140 23260 catalog_manager.cc:4841] TS e3124622d5d54e5884e2446bc36facb8 (127.16.188.195:45237): tablet 152d22e977a64a9fbdd1dfe6fdf8a091 (table test-table [id=eb9463422e46490ea111a42c81391bc3]) successfully deleted
I20260809 18:56:45.984371 24066 ts_tablet_manager.cc:1918] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:45.984539 24066 log.cc:1196] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/152d22e977a64a9fbdd1dfe6fdf8a091
I20260809 18:56:45.985018 24066 ts_tablet_manager.cc:1939] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 44256922445047f8afe190892c704573: Deleting consensus metadata
I20260809 18:56:45.985396 24068 tablet_replica.cc:330] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: stopping tablet replica
I20260809 18:56:45.985838 24068 raft_consensus.cc:2229] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:45.986397 24068 raft_consensus.cc:2258] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:45.986768 23255 catalog_manager.cc:4841] TS 44256922445047f8afe190892c704573 (127.16.188.193:41947): tablet 152d22e977a64a9fbdd1dfe6fdf8a091 (table test-table [id=eb9463422e46490ea111a42c81391bc3]) successfully deleted
I20260809 18:56:45.988318 24068 ts_tablet_manager.cc:1905] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:45.993384 24068 ts_tablet_manager.cc:1918] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:45.993525 24068 log.cc:1196] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/152d22e977a64a9fbdd1dfe6fdf8a091
I20260809 18:56:45.993963 24068 ts_tablet_manager.cc:1939] T 152d22e977a64a9fbdd1dfe6fdf8a091 P 14fc7b3c901442d6a7ab7f83e8d7f43f: Deleting consensus metadata
I20260809 18:56:45.995067 24027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:45.960079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59890 (local address 127.16.188.193:41947)
0809 18:56:45.960273 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:45.960279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:45.973157 (+ 12878us) server_negotiation.cc:407] Connection header received
0809 18:56:45.973996 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:45.974002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:45.974089 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:45.974196 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:45.975643 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.976707 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.978781 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:45.979425 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:45.979517 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:45.988042 (+ 8525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:45.988056 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:45.988083 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:45.988124 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:45.991857 (+ 3733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:45.992693 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:45.992702 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:45.992706 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:45.992874 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:45.993343 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:45.993348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:45.993352 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:45.993802 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:45.994129 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:45.994486 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 18:56:45.994705 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 18:56:45.995553 23258 catalog_manager.cc:4841] TS 14fc7b3c901442d6a7ab7f83e8d7f43f (127.16.188.194:41239): tablet 152d22e977a64a9fbdd1dfe6fdf8a091 (table test-table [id=eb9463422e46490ea111a42c81391bc3]) successfully deleted
I20260809 18:56:45.995728 23576 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:46.082655 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 23381
I20260809 18:56:46.118786 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 23599
Aug 09 18:56:46 dist-test-slave-266d krb5kdc[23209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:56:46.133780 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.119611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56894 (local address 127.16.188.194:41239)
0809 18:56:46.119828 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:46.119834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:46.119856 (+ 22us) server_negotiation.cc:407] Connection header received
0809 18:56:46.119921 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:46.119927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:46.119989 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:46.120073 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:46.121357 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.122127 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.123388 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.123784 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.123896 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.128091 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:46.128105 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:46.128122 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:46.128162 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:46.131120 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.131761 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.131768 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.131771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.131896 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.132242 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.132247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.132251 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.132616 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:46.132911 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:46.133258 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 18:56:46.133470 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 18:56:46.134491 23804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:46.221648 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 23599
I20260809 18:56:46.243633 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 23818
Aug 09 18:56:46 dist-test-slave-266d krb5kdc[23209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:56:46.261765 24035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.244409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55562 (local address 127.16.188.195:45237)
0809 18:56:46.244622 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:46.244628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:46.244656 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:56:46.244740 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:46.244746 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:46.244840 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:46.244964 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:46.246289 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.247559 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.248798 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:46.249593 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:46.249754 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:46.254137 (+ 4383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:46.254154 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:46.254174 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:46.254226 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:46.258579 (+ 4353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.259255 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.259266 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.259275 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.259510 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:46.259873 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:46.259878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:46.259882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:46.260415 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:46.260790 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:46.260971 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 18:56:46.261247 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 18:56:46.262619 23991 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:46.382995 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 23818
I20260809 18:56:46.403977 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 23230
I20260809 18:56:46.405151 23335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:46.512379 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 23230
2026-08-09T18:56:46Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4115 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T18:56:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:46Z Disabled control of system clock
I20260809 18:56:46.587451 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:45117
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:46479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:45117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:56:46.903970 24084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:46.904238 24084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:46.904366 24084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:46.911339 24084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:46.911440 24084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:46.911504 24084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:46.911582 24084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:46.911639 24084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:46.920410 24084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:45117
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:45117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:46.921576 24084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:46.923355 24084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:46.934402 24095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:46.934407 24090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:46.934407 24092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:46.935202 24084 server_base.cc:1034] running on GCE node
I20260809 18:56:46.935895 24084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:46.937258 24084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:46.938495 24084 hybrid_clock.cc:648] HybridClock initialized: now 1786301806938429 us; error 36 us; skew 500 ppm
I20260809 18:56:46.938855 24084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:56:46.940958 24084 webserver.cc:460] Webserver started at http://127.16.188.254:45753/ using document root <none> and password file <none>
I20260809 18:56:46.941612 24084 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:46.941699 24084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:46.941968 24084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:46.944753 24084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "967de1f288db4ea9b945273900318748"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-266d"
server_key: "1f215d762d7360d29c83773ef4de2faf"
server_key_iv: "02843283b08e198d5717ffa6ea07bde6"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.945513 24084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "967de1f288db4ea9b945273900318748"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-266d"
server_key: "1f215d762d7360d29c83773ef4de2faf"
server_key_iv: "02843283b08e198d5717ffa6ea07bde6"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.950132 24084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 18:56:46.953233 24105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:46.954384 24084 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 18:56:46.954530 24084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "967de1f288db4ea9b945273900318748"
format_stamp: "Formatted at 2026-08-09 18:56:46 on dist-test-slave-266d"
server_key: "1f215d762d7360d29c83773ef4de2faf"
server_key_iv: "02843283b08e198d5717ffa6ea07bde6"
server_key_version: "encryptionkey@0"
I20260809 18:56:46.954716 24084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:46.960101 24084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:46.960786 24084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:46.961045 24084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:46.977689 24084 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:45117
I20260809 18:56:46.977742 24181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:45117 every 8 connection(s)
I20260809 18:56:46.978893 24084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:46.982337 24183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:46.983592 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 24084
I20260809 18:56:46.983780 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:46.984387 17139 external_mini_cluster.cc:1428] Setting key 350b775c07594af8b6a95d14def40585
I20260809 18:56:46.992093 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:46.986279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45042 (local address 127.16.188.254:45117)
0809 18:56:46.987264 (+ 985us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:46.987274 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:46.987319 (+ 45us) server_negotiation.cc:407] Connection header received
0809 18:56:46.988859 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:46.988878 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:46.989293 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:46.989592 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:46.990657 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:46.990663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:46.990675 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:46.990688 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:46.990760 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:46.990777 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:46.990946 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:46.991038 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 18:56:46.991250 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":363,"threads_started":1}
I20260809 18:56:46.993078 24183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748: Bootstrap starting.
I20260809 18:56:46.995819 24183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:46.996744 24183 log.cc:824] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:46.999200 24183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748: No bootstrap required, opened a new log
I20260809 18:56:47.006093 24183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "967de1f288db4ea9b945273900318748" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45117 } }
I20260809 18:56:47.006414 24183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:47.006498 24183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 967de1f288db4ea9b945273900318748, State: Initialized, Role: FOLLOWER
I20260809 18:56:47.006985 24183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "967de1f288db4ea9b945273900318748" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45117 } }
I20260809 18:56:47.007186 24183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:47.007311 24183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:47.007457 24183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:47.009464 24183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "967de1f288db4ea9b945273900318748" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45117 } }
I20260809 18:56:47.009898 24183 leader_election.cc:302] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 967de1f288db4ea9b945273900318748; no voters:
I20260809 18:56:47.010428 24183 leader_election.cc:288] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:47.010531 24189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:47.011160 24189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [term 1 LEADER]: Becoming Leader. State: Replica: 967de1f288db4ea9b945273900318748, State: Running, Role: LEADER
I20260809 18:56:47.011664 24189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "967de1f288db4ea9b945273900318748" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45117 } }
I20260809 18:56:47.012226 24183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:47.013991 24192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 967de1f288db4ea9b945273900318748. Latest consensus state: current_term: 1 leader_uuid: "967de1f288db4ea9b945273900318748" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "967de1f288db4ea9b945273900318748" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45117 } } }
I20260809 18:56:47.014343 24192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:47.014374 24191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "967de1f288db4ea9b945273900318748" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "967de1f288db4ea9b945273900318748" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45117 } } }
I20260809 18:56:47.014839 24191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:47.018478 24198 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:47.023130 24198 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:47.031335 24198 catalog_manager.cc:1347] Generated new cluster ID: 5114a8be7b5f4d16893a7477f4c5ba26
I20260809 18:56:47.031426 24198 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:47.040995 24198 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:47.041422 24198 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:47.051342 24198 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748: Generated new TSK 0
I20260809 18:56:47.051978 24198 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:56:47.066864 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45117
--builtin_ntp_servers=127.16.188.212:46479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:56:47.388022 24220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:47.388305 24220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:47.388432 24220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:47.395668 24220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:47.395779 24220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:47.395928 24220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:47.404687 24220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:47.405925 24220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:47.407634 24220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:47.420265 24233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:47.420239 24236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:47.420403 24232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:47.420822 24220 server_base.cc:1034] running on GCE node
I20260809 18:56:47.421551 24220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:47.422406 24220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:47.423589 24220 hybrid_clock.cc:648] HybridClock initialized: now 1786301807423537 us; error 42 us; skew 500 ppm
I20260809 18:56:47.423873 24220 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:56:47.425936 24220 webserver.cc:460] Webserver started at http://127.16.188.193:46593/ using document root <none> and password file <none>
I20260809 18:56:47.426550 24220 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:47.426640 24220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:47.426975 24220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:47.429746 24220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "362bfbced72e4df38844af9de58e6606"
format_stamp: "Formatted at 2026-08-09 18:56:47 on dist-test-slave-266d"
server_key: "7778cb62762435aaba54f35016b059f7"
server_key_iv: "0a20fd3f6ff8e97b1b981fe8f4723b9c"
server_key_version: "encryptionkey@0"
I20260809 18:56:47.430516 24220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "362bfbced72e4df38844af9de58e6606"
format_stamp: "Formatted at 2026-08-09 18:56:47 on dist-test-slave-266d"
server_key: "7778cb62762435aaba54f35016b059f7"
server_key_iv: "0a20fd3f6ff8e97b1b981fe8f4723b9c"
server_key_version: "encryptionkey@0"
I20260809 18:56:47.435397 24220 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 18:56:47.438639 24247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:47.439802 24220 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:56:47.439939 24220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "362bfbced72e4df38844af9de58e6606"
format_stamp: "Formatted at 2026-08-09 18:56:47 on dist-test-slave-266d"
server_key: "7778cb62762435aaba54f35016b059f7"
server_key_iv: "0a20fd3f6ff8e97b1b981fe8f4723b9c"
server_key_version: "encryptionkey@0"
I20260809 18:56:47.440119 24220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:47.445310 24220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:47.446012 24220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:47.446246 24220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:47.447115 24220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:47.448483 24220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:47.448565 24220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:47.448647 24220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:47.448712 24220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:47.477737 24220 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:39207
I20260809 18:56:47.477797 24428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:39207 every 8 connection(s)
I20260809 18:56:47.478947 24220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:47.486418 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:47.481278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:53951 (local address 127.16.188.254:45117)
0809 18:56:47.481453 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:47.481458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:47.482769 (+ 1311us) server_negotiation.cc:407] Connection header received
0809 18:56:47.484385 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:47.484391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:47.484456 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:47.484545 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:47.485728 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:47.485733 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:47.485738 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:47.485754 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:47.485788 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:47.485800 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:47.485899 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:47.486075 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 18:56:47.486140 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:56:47.487210 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:47.481746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45117 (local address 127.16.188.193:53951)
0809 18:56:47.482631 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:47.482664 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:47.484124 (+ 1460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:47.484774 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:47.484782 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:47.484865 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:47.485448 (+ 583us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:47.485450 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:47.485483 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:47.485565 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:47.485882 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:47.485891 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:47.485899 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 18:56:47.486142 (+ 243us) client_negotiation.cc:240] Negotiation successful
0809 18:56:47.486367 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":289,"threads_started":1}
I20260809 18:56:47.487951 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 24220
I20260809 18:56:47.488152 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:47.488556 24430 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45117
I20260809 18:56:47.488797 17139 external_mini_cluster.cc:1428] Setting key 5d52e1485c0e1f80907ed97a3c9a73dd
I20260809 18:56:47.488833 24430 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:47.489456 24430 heartbeater.cc:511] Master 127.16.188.254:45117 requested a full tablet report, sending...
I20260809 18:56:47.491467 24132 ts_manager.cc:194] Registered new tserver with Master: 362bfbced72e4df38844af9de58e6606 (127.16.188.193:39207)
I20260809 18:56:47.491554 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45117
--builtin_ntp_servers=127.16.188.212:46479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:56:47.810731 24433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:47.811013 24433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:47.811136 24433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:47.818204 24433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:47.818305 24433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:47.818455 24433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:47.827201 24433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:47.828460 24433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:47.830236 24433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:47.849081 24441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:47.849136 24442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:47.849203 24444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:47.851258 24433 server_base.cc:1034] running on GCE node
I20260809 18:56:47.851898 24433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:47.852873 24433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:47.854075 24433 hybrid_clock.cc:648] HybridClock initialized: now 1786301807854009 us; error 59 us; skew 500 ppm
I20260809 18:56:47.854389 24433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:56:47.856581 24433 webserver.cc:460] Webserver started at http://127.16.188.194:41303/ using document root <none> and password file <none>
I20260809 18:56:47.857317 24433 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:47.857421 24433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:47.857775 24433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:47.860658 24433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "e3078ce0b9e14fe7b78f65f1f4039d04"
format_stamp: "Formatted at 2026-08-09 18:56:47 on dist-test-slave-266d"
server_key: "a9052168a437e1a94e937931e679c153"
server_key_iv: "677cb4b467b60d35c2532595e496c353"
server_key_version: "encryptionkey@0"
I20260809 18:56:47.861464 24433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "e3078ce0b9e14fe7b78f65f1f4039d04"
format_stamp: "Formatted at 2026-08-09 18:56:47 on dist-test-slave-266d"
server_key: "a9052168a437e1a94e937931e679c153"
server_key_iv: "677cb4b467b60d35c2532595e496c353"
server_key_version: "encryptionkey@0"
I20260809 18:56:47.866317 24433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 18:56:47.869647 24451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:47.870925 24433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 18:56:47.871091 24433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "e3078ce0b9e14fe7b78f65f1f4039d04"
format_stamp: "Formatted at 2026-08-09 18:56:47 on dist-test-slave-266d"
server_key: "a9052168a437e1a94e937931e679c153"
server_key_iv: "677cb4b467b60d35c2532595e496c353"
server_key_version: "encryptionkey@0"
I20260809 18:56:47.871299 24433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:47.876840 24433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:47.877715 24433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:47.877966 24433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:47.878855 24433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:47.880278 24433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:47.880376 24433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:47.880486 24433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:47.880554 24433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:47.910131 24433 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:38681
I20260809 18:56:47.910180 24634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:38681 every 8 connection(s)
I20260809 18:56:47.911402 24433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:47.918944 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:47.913942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:43809 (local address 127.16.188.254:45117)
0809 18:56:47.914108 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:47.914113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:47.915460 (+ 1347us) server_negotiation.cc:407] Connection header received
0809 18:56:47.917019 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:47.917023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:47.917075 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:47.917189 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:47.918376 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:47.918380 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:47.918383 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:47.918396 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:47.918423 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:47.918433 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:47.918517 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:47.918678 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 18:56:47.918723 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 18:56:47.919775 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:47.914454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45117 (local address 127.16.188.194:43809)
0809 18:56:47.915311 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:47.915349 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:47.916801 (+ 1452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:47.917372 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:47.917380 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:47.917463 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:47.918102 (+ 639us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:47.918104 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:47.918140 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:47.918242 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:47.918497 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:47.918504 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:47.918509 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:47.918739 (+ 230us) client_negotiation.cc:240] Negotiation successful
0809 18:56:47.918915 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":255,"threads_started":1}
I20260809 18:56:47.920956 24635 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45117
I20260809 18:56:47.921144 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 24433
I20260809 18:56:47.921241 24635 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:47.921321 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:47.921754 17139 external_mini_cluster.cc:1428] Setting key 832f0b428e1dcb8364b9531bcc53eb79
I20260809 18:56:47.921809 24635 heartbeater.cc:511] Master 127.16.188.254:45117 requested a full tablet report, sending...
I20260809 18:56:47.923086 24130 ts_manager.cc:194] Registered new tserver with Master: e3078ce0b9e14fe7b78f65f1f4039d04 (127.16.188.194:38681)
I20260809 18:56:47.924352 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45117
--builtin_ntp_servers=127.16.188.212:46479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:56:48.254576 24640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:48.254848 24640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:48.254952 24640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:48.262205 24640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:48.262305 24640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:48.262428 24640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:48.271304 24640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:48.272572 24640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:48.274427 24640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:48.287336 24654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:48.287407 24651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:48.287384 24649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:48.288126 24640 server_base.cc:1034] running on GCE node
I20260809 18:56:48.288693 24640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:48.289630 24640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:48.290902 24640 hybrid_clock.cc:648] HybridClock initialized: now 1786301808290856 us; error 45 us; skew 500 ppm
I20260809 18:56:48.291177 24640 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:56:48.293278 24640 webserver.cc:460] Webserver started at http://127.16.188.195:45069/ using document root <none> and password file <none>
I20260809 18:56:48.293887 24640 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:48.293982 24640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:48.294288 24640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:48.296931 24640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "98a41b95e6964ebcbd5e7c2d364b4c98"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-266d"
server_key: "329f19ef4fd8c33e16eac2567797b983"
server_key_iv: "df30ab02da3710f5fc7d2222ad040c74"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.297700 24640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "98a41b95e6964ebcbd5e7c2d364b4c98"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-266d"
server_key: "329f19ef4fd8c33e16eac2567797b983"
server_key_iv: "df30ab02da3710f5fc7d2222ad040c74"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.302413 24640 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 18:56:48.305660 24662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.306840 24640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:48.306980 24640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "98a41b95e6964ebcbd5e7c2d364b4c98"
format_stamp: "Formatted at 2026-08-09 18:56:48 on dist-test-slave-266d"
server_key: "329f19ef4fd8c33e16eac2567797b983"
server_key_iv: "df30ab02da3710f5fc7d2222ad040c74"
server_key_version: "encryptionkey@0"
I20260809 18:56:48.307161 24640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:48.312534 24640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:48.313301 24640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:48.313539 24640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:48.314407 24640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:48.315704 24640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:48.315804 24640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.315909 24640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:48.315974 24640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:48.345685 24640 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:43555
I20260809 18:56:48.345758 24846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:43555 every 8 connection(s)
I20260809 18:56:48.346935 24640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:48.353470 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 24640
I20260809 18:56:48.353690 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:48.354187 17139 external_mini_cluster.cc:1428] Setting key 18b533c565f2e9143cc0e87c5dbd93a9
I20260809 18:56:48.354928 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.349497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:42171 (local address 127.16.188.254:45117)
0809 18:56:48.349749 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.349756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.351136 (+ 1380us) server_negotiation.cc:407] Connection header received
0809 18:56:48.352747 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.352752 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.352812 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.352911 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.354207 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.354214 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.354219 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.354243 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.354286 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.354305 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.354467 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.354606 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.354674 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 18:56:48.355845 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.350101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45117 (local address 127.16.188.195:42171)
0809 18:56:48.350980 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.351022 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.352501 (+ 1479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.353081 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.353113 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.353212 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.353908 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:48.353910 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.353947 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:48.354028 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.354416 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.354424 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.354430 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.354634 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.354839 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":273,"threads_started":1}
I20260809 18:56:48.357069 24847 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45117
I20260809 18:56:48.357419 24847 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:48.358076 24847 heartbeater.cc:511] Master 127.16.188.254:45117 requested a full tablet report, sending...
I20260809 18:56:48.359396 24130 ts_manager.cc:194] Registered new tserver with Master: 98a41b95e6964ebcbd5e7c2d364b4c98 (127.16.188.195:43555)
I20260809 18:56:48.369490 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:56:48.375888 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.373689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45044 (local address 127.16.188.254:45117)
0809 18:56:48.373859 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.373863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.374265 (+ 402us) server_negotiation.cc:407] Connection header received
0809 18:56:48.374402 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.374405 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.374455 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.374534 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.375364 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.375368 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.375371 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.375386 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.375416 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.375427 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.375518 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.375588 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.375649 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 18:56:48.379662 24130 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45044:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:56:48.386430 24130 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:56:48.404299 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.397648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43555 (local address 127.0.0.1:42364)
0809 18:56:48.399794 (+ 2146us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.399811 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.399894 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.401794 (+ 1900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.401799 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.401823 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.402567 (+ 744us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:48.402571 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.402605 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:48.402700 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.403466 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.403479 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.403489 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.403699 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.403802 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2011,"thread_start_us":999,"threads_started":1}
I20260809 18:56:48.404366 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.398004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42364 (local address 127.16.188.195:43555)
0809 18:56:48.401291 (+ 3287us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.401297 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.401324 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:56:48.401377 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.401381 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.401589 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.402173 (+ 584us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.403192 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.403199 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.403209 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.403226 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.403283 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.403308 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.403517 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.403901 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.404011 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3141,"thread_start_us":2971,"threads_started":1}
I20260809 18:56:48.404702 24876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.400012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40524 (local address 127.16.188.193:39207)
0809 18:56:48.400904 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.400913 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.400944 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:56:48.401019 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.401027 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.401305 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.401467 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.403093 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.403101 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.403115 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.403291 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.403429 (+ 138us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.403456 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.404220 (+ 764us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.404310 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.404406 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":593,"threads_started":1}
I20260809 18:56:48.404942 24875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.399438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.0.0.1:40524)
0809 18:56:48.400325 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.400340 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.400416 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.401497 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.401504 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.401585 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.402841 (+ 1256us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:48.402844 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.402864 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:48.402914 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.403575 (+ 661us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.403580 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.403585 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.403734 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.403822 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"mutex_wait_us":23,"spinlock_wait_cycles":4864,"thread_start_us":765,"threads_started":1}
I20260809 18:56:48.407040 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.397550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:38681 (local address 127.0.0.1:42294)
0809 18:56:48.399053 (+ 1503us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.399120 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.399257 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.404412 (+ 5155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.404416 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.404437 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.405116 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:48.405120 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.405136 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:48.405177 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.406431 (+ 1254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.406437 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.406442 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.406559 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.406606 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1236,"thread_start_us":1919,"threads_started":1}
I20260809 18:56:48.407624 24871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.397793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42294 (local address 127.16.188.194:38681)
0809 18:56:48.403929 (+ 6136us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.403936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.403964 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:56:48.404032 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.404039 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.404235 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.405257 (+ 1022us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.406178 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.406186 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.406199 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.406226 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.406286 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.406306 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.407121 (+ 815us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.407199 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.407294 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5975,"thread_start_us":5840,"threads_started":1}
I20260809 18:56:48.408645 24740 tablet_service.cc:1467] Processing CreateTablet for tablet c4a370011da94d78bc14363932e7d6b4 (DEFAULT_TABLE table=test-table [id=e7a835588c284bbdb08b5203cf7003d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:48.408645 24329 tablet_service.cc:1467] Processing CreateTablet for tablet c4a370011da94d78bc14363932e7d6b4 (DEFAULT_TABLE table=test-table [id=e7a835588c284bbdb08b5203cf7003d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:48.410120 24329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a370011da94d78bc14363932e7d6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:48.410117 24740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a370011da94d78bc14363932e7d6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:48.410543 24530 tablet_service.cc:1467] Processing CreateTablet for tablet c4a370011da94d78bc14363932e7d6b4 (DEFAULT_TABLE table=test-table [id=e7a835588c284bbdb08b5203cf7003d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:56:48.411844 24530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a370011da94d78bc14363932e7d6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:48.423025 24879 tablet_bootstrap.cc:492] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: Bootstrap starting.
I20260809 18:56:48.424921 24881 tablet_bootstrap.cc:492] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606: Bootstrap starting.
I20260809 18:56:48.426496 24879 tablet_bootstrap.cc:654] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:48.427711 24879 log.cc:824] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:48.428283 24881 tablet_bootstrap.cc:654] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:48.429564 24881 log.cc:824] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:48.430347 24882 tablet_bootstrap.cc:492] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: Bootstrap starting.
I20260809 18:56:48.431553 24879 tablet_bootstrap.cc:492] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: No bootstrap required, opened a new log
I20260809 18:56:48.431830 24879 ts_tablet_manager.cc:1397] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 18:56:48.432044 24881 tablet_bootstrap.cc:492] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606: No bootstrap required, opened a new log
I20260809 18:56:48.432286 24881 ts_tablet_manager.cc:1397] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 18:56:48.433640 24882 tablet_bootstrap.cc:654] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:48.434746 24882 log.cc:824] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:48.437580 24882 tablet_bootstrap.cc:492] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: No bootstrap required, opened a new log
I20260809 18:56:48.437835 24882 ts_tablet_manager.cc:1397] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 18:56:48.439838 24881 raft_consensus.cc:348] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.440176 24881 raft_consensus.cc:374] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:48.440271 24881 raft_consensus.cc:729] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 362bfbced72e4df38844af9de58e6606, State: Initialized, Role: FOLLOWER
I20260809 18:56:48.440815 24881 consensus_queue.cc:260] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.441215 24879 raft_consensus.cc:348] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.441653 24879 raft_consensus.cc:374] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:48.441783 24879 raft_consensus.cc:729] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3078ce0b9e14fe7b78f65f1f4039d04, State: Initialized, Role: FOLLOWER
I20260809 18:56:48.441854 24430 heartbeater.cc:503] Master 127.16.188.254:45117 was elected leader, sending a full tablet report...
I20260809 18:56:48.442435 24881 ts_tablet_manager.cc:1428] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606: Time spent starting tablet: real 0.010s user 0.007s sys 0.003s
I20260809 18:56:48.442541 24879 consensus_queue.cc:260] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.443537 24635 heartbeater.cc:503] Master 127.16.188.254:45117 was elected leader, sending a full tablet report...
I20260809 18:56:48.445611 24879 ts_tablet_manager.cc:1428] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260809 18:56:48.447297 24882 raft_consensus.cc:348] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.447736 24882 raft_consensus.cc:374] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:48.447875 24882 raft_consensus.cc:729] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a41b95e6964ebcbd5e7c2d364b4c98, State: Initialized, Role: FOLLOWER
I20260809 18:56:48.448468 24882 consensus_queue.cc:260] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.449417 24847 heartbeater.cc:503] Master 127.16.188.254:45117 was elected leader, sending a full tablet report...
I20260809 18:56:48.449995 24882 ts_tablet_manager.cc:1428] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
W20260809 18:56:48.480937 24431 tablet.cc:2369] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:56:48.485687 24892 raft_consensus.cc:482] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:56:48.485937 24892 raft_consensus.cc:504] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.487432 24892 leader_election.cc:288] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3078ce0b9e14fe7b78f65f1f4039d04 (127.16.188.194:38681), 362bfbced72e4df38844af9de58e6606 (127.16.188.193:39207)
I20260809 18:56:48.489912 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.487948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.16.188.195:40423)
0809 18:56:48.488111 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.488134 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.488231 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.488515 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.488520 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.488546 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.489124 (+ 578us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:48.489128 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.489147 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:48.489192 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.489484 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.489489 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.489493 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.489616 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.489669 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 18:56:48.489917 24876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.487918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:40423 (local address 127.16.188.193:39207)
0809 18:56:48.488073 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.488076 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.488195 (+ 119us) server_negotiation.cc:407] Connection header received
0809 18:56:48.488320 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.488323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.488368 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.488458 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.489332 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.489336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.489340 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.489354 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.489385 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.489396 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.489492 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.489607 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.489665 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:56:48.490792 24871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.487816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:37921 (local address 127.16.188.194:38681)
0809 18:56:48.488013 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.488020 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.489051 (+ 1031us) server_negotiation.cc:407] Connection header received
0809 18:56:48.489222 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.489226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.489275 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.489353 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.490293 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.490300 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.490305 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.490327 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.490366 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.490382 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.490514 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.490562 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.490608 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 18:56:48.491091 24893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.487965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:38681 (local address 127.16.188.195:37921)
0809 18:56:48.488958 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.488972 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:48.489074 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:48.489394 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:48.489398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:48.489421 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:48.490048 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:56:48.490052 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:48.490071 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:56:48.490114 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:48.490477 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:48.490481 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:48.490485 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:56:48.490584 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 18:56:48.490662 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"mutex_wait_us":335,"thread_start_us":377,"threads_started":1}
I20260809 18:56:48.490945 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a370011da94d78bc14363932e7d6b4" candidate_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "362bfbced72e4df38844af9de58e6606" is_pre_election: true
I20260809 18:56:48.491499 24355 raft_consensus.cc:2454] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98a41b95e6964ebcbd5e7c2d364b4c98 in term 0.
I20260809 18:56:48.492013 24564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a370011da94d78bc14363932e7d6b4" candidate_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" is_pre_election: true
I20260809 18:56:48.492128 24663 leader_election.cc:302] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 362bfbced72e4df38844af9de58e6606, 98a41b95e6964ebcbd5e7c2d364b4c98; no voters:
I20260809 18:56:48.492441 24892 raft_consensus.cc:2781] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:56:48.492415 24564 raft_consensus.cc:2454] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98a41b95e6964ebcbd5e7c2d364b4c98 in term 0.
I20260809 18:56:48.492555 24892 raft_consensus.cc:482] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:56:48.492650 24892 raft_consensus.cc:3037] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:48.494903 24892 raft_consensus.cc:504] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.495523 24892 leader_election.cc:288] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [CANDIDATE]: Term 1 election: Requested vote from peers e3078ce0b9e14fe7b78f65f1f4039d04 (127.16.188.194:38681), 362bfbced72e4df38844af9de58e6606 (127.16.188.193:39207)
I20260809 18:56:48.495905 24564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a370011da94d78bc14363932e7d6b4" candidate_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04"
I20260809 18:56:48.495939 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a370011da94d78bc14363932e7d6b4" candidate_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "362bfbced72e4df38844af9de58e6606"
I20260809 18:56:48.496109 24355 raft_consensus.cc:3037] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:48.496109 24564 raft_consensus.cc:3037] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:48.499189 24355 raft_consensus.cc:2454] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98a41b95e6964ebcbd5e7c2d364b4c98 in term 1.
I20260809 18:56:48.499185 24564 raft_consensus.cc:2454] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98a41b95e6964ebcbd5e7c2d364b4c98 in term 1.
I20260809 18:56:48.499576 24667 leader_election.cc:302] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 362bfbced72e4df38844af9de58e6606, 98a41b95e6964ebcbd5e7c2d364b4c98, e3078ce0b9e14fe7b78f65f1f4039d04; no voters:
I20260809 18:56:48.499934 24892 raft_consensus.cc:2781] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:48.500375 24892 raft_consensus.cc:686] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 1 LEADER]: Becoming Leader. State: Replica: 98a41b95e6964ebcbd5e7c2d364b4c98, State: Running, Role: LEADER
I20260809 18:56:48.501008 24892 consensus_queue.cc:237] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } }
I20260809 18:56:48.505348 24132 catalog_manager.cc:5495] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98a41b95e6964ebcbd5e7c2d364b4c98 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98a41b95e6964ebcbd5e7c2d364b4c98" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 } health_report { overall_health: UNKNOWN } } }
I20260809 18:56:48.527761 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.525807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42372 (local address 127.16.188.195:43555)
0809 18:56:48.525992 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.525998 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.526135 (+ 137us) server_negotiation.cc:407] Connection header received
0809 18:56:48.526299 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.526304 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.526388 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.526477 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.527212 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.527216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.527220 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.527235 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.527269 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.527282 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.527389 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.527425 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.527471 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 18:56:48.535933 24564 raft_consensus.cc:1261] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 1 FOLLOWER]: Refusing update from remote peer 98a41b95e6964ebcbd5e7c2d364b4c98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:48.535997 24355 raft_consensus.cc:1261] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 1 FOLLOWER]: Refusing update from remote peer 98a41b95e6964ebcbd5e7c2d364b4c98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:56:48.536863 24892 consensus_queue.cc:1035] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "362bfbced72e4df38844af9de58e6606" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 39207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:48.537161 24894 consensus_queue.cc:1035] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3078ce0b9e14fe7b78f65f1f4039d04" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 38681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:56:48.553200 24903 mvcc.cc:205] Tried to move back new op lower bound from 7316692207754014720 to 7316692207624187904. Current Snapshot: MvccSnapshot[applied={T|T < 7316692207754014720}]
I20260809 18:56:48.561113 24132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45044:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:48.561388 24132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45044:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:56:48.564844 24132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 967de1f288db4ea9b945273900318748: Sending DeleteTablet for 3 replicas of tablet c4a370011da94d78bc14363932e7d6b4
I20260809 18:56:48.565873 24530 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a370011da94d78bc14363932e7d6b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:48 UTC) from {username='slave'} at 127.0.0.1:42294
I20260809 18:56:48.566079 24329 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a370011da94d78bc14363932e7d6b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:48 UTC) from {username='slave'} at 127.0.0.1:40524
I20260809 18:56:48.566938 24740 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a370011da94d78bc14363932e7d6b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:56:48 UTC) from {username='slave'} at 127.0.0.1:42364
I20260809 18:56:48.567276 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 24220
I20260809 18:56:48.578553 24918 tablet_replica.cc:330] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: stopping tablet replica
I20260809 18:56:48.579106 24918 raft_consensus.cc:2229] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:48.579704 24918 raft_consensus.cc:2258] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:48.581013 24876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.568608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40530 (local address 127.16.188.193:39207)
0809 18:56:48.568783 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.568790 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.578480 (+ 9690us) server_negotiation.cc:407] Connection header received
0809 18:56:48.578891 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.578897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.579007 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.579085 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.580259 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.580264 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.580269 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.580288 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.580323 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.580336 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.580417 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.580659 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.580721 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:56:48.582096 24415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:48.581800 24918 ts_tablet_manager.cc:1905] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:48.586822 24923 tablet_replica.cc:330] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: stopping tablet replica
I20260809 18:56:48.587231 24923 raft_consensus.cc:2229] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:56:48.587885 24923 raft_consensus.cc:2258] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:48.589691 24918 ts_tablet_manager.cc:1918] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:48.589897 24918 log.cc:1196] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/c4a370011da94d78bc14363932e7d6b4
I20260809 18:56:48.590467 24918 ts_tablet_manager.cc:1939] T c4a370011da94d78bc14363932e7d6b4 P e3078ce0b9e14fe7b78f65f1f4039d04: Deleting consensus metadata
I20260809 18:56:48.591490 24923 ts_tablet_manager.cc:1905] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:56:48.592335 24108 catalog_manager.cc:4841] TS e3078ce0b9e14fe7b78f65f1f4039d04 (127.16.188.194:38681): tablet c4a370011da94d78bc14363932e7d6b4 (table test-table [id=e7a835588c284bbdb08b5203cf7003d5]) successfully deleted
I20260809 18:56:48.598881 24923 ts_tablet_manager.cc:1918] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:56:48.599129 24923 log.cc:1196] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/c4a370011da94d78bc14363932e7d6b4
I20260809 18:56:48.599769 24923 ts_tablet_manager.cc:1939] T c4a370011da94d78bc14363932e7d6b4 P 98a41b95e6964ebcbd5e7c2d364b4c98: Deleting consensus metadata
I20260809 18:56:48.601630 24106 catalog_manager.cc:4841] TS 98a41b95e6964ebcbd5e7c2d364b4c98 (127.16.188.195:43555): tablet c4a370011da94d78bc14363932e7d6b4 (table test-table [id=e7a835588c284bbdb08b5203cf7003d5]) successfully deleted
I20260809 18:56:48.686641 24919 tablet_replica.cc:330] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606: stopping tablet replica
I20260809 18:56:48.687160 24919 raft_consensus.cc:2229] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:56:48.687685 24919 raft_consensus.cc:2258] T c4a370011da94d78bc14363932e7d6b4 P 362bfbced72e4df38844af9de58e6606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:56:48.689532 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 24220
I20260809 18:56:48.712713 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 24433
W20260809 18:56:48.712790 24106 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.188.193:39207 (error 108)
I20260809 18:56:48.715081 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.714603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.0.0.1:40532)
0809 18:56:48.714776 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.714913 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 18:56:48.715312 24106 catalog_manager.cc:4584] TS 362bfbced72e4df38844af9de58e6606 (127.16.188.193:39207): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c4a370011da94d78bc14363932e7d6b4: Network error: Client connection negotiation failed: client connection to 127.16.188.193:39207: connect: Connection refused (error 111)
I20260809 18:56:48.716280 24871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.713636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42310 (local address 127.16.188.194:38681)
0809 18:56:48.714210 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.714215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.714230 (+ 15us) server_negotiation.cc:407] Connection header received
0809 18:56:48.714286 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.714290 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.714386 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.714491 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.715476 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.715482 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.715486 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.715507 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.715548 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.715566 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.715710 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.715923 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.715990 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431}
I20260809 18:56:48.716917 24627 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:48.769373 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.768734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.0.0.1:40546)
0809 18:56:48.768984 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.769160 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 18:56:48.770566 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.770170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.0.0.1:40558)
0809 18:56:48.770329 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.770417 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 18:56:48.802908 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 24433
I20260809 18:56:48.828078 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 24640
I20260809 18:56:48.830977 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.828818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42376 (local address 127.16.188.195:43555)
0809 18:56:48.829009 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:48.829016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:48.829128 (+ 112us) server_negotiation.cc:407] Connection header received
0809 18:56:48.829343 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:48.829347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:48.829399 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:48.829487 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:48.830352 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:48.830358 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:48.830363 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:48.830380 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:48.830410 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:48.830425 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:48.830553 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:48.830627 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 18:56:48.830687 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 18:56:48.831168 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.830608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.0.0.1:40562)
0809 18:56:48.830877 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.830985 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260809 18:56:48.831964 24839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:48.832428 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.832089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.0.0.1:40568)
0809 18:56:48.832246 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.832313 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 18:56:48.913156 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.912663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.0.0.1:40578)
0809 18:56:48.912874 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.912974 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 18:56:48.914192 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:48.913820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:39207 (local address 127.0.0.1:40582)
0809 18:56:48.914008 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:48.914075 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 18:56:48.949580 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 24640
I20260809 18:56:48.977171 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 24084
I20260809 18:56:48.978350 24177 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:49.084060 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 24084
2026-08-09T18:56:49Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2568 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 18:56:49.129524 17139 mini_oidc.cc:152] Starting JWKS server
I20260809 18:56:49.132359 17139 webserver.cc:460] Webserver started at https://127.0.0.1:34625/ using document root <none> and password file <none>
I20260809 18:56:49.132593 17139 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:56:49.133231 17139 webserver.cc:460] Webserver started at http://127.0.0.1:39335/ using document root <none> and password file <none>
2026-08-09T18:56:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:49Z Disabled control of system clock
I20260809 18:56:49.160683 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:37295
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:34671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:37295
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34625/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/testchainca.cert with env {}
W20260809 18:56:49.474084 24939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:49.474359 24939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:49.474488 24939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:49.481412 24939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:49.481523 24939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:49.481594 24939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:49.481678 24939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:49.481745 24939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:56:49.481827 24939 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:56:49.481882 24939 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34625/jwks.json
I20260809 18:56:49.491335 24939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:34671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:37295
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:37295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34625/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:49.492522 24939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:49.493789 24939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:49.505076 24947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:49.505160 24949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:49.505159 24955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:49.505965 24939 server_base.cc:1034] running on GCE node
I20260809 18:56:49.506735 24939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:49.508045 24939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:49.509246 24939 hybrid_clock.cc:648] HybridClock initialized: now 1786301809509201 us; error 39 us; skew 500 ppm
I20260809 18:56:49.509572 24939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:56:49.511659 24939 webserver.cc:460] Webserver started at http://127.16.188.254:35703/ using document root <none> and password file <none>
I20260809 18:56:49.512305 24939 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:49.512409 24939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:49.512697 24939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:49.515451 24939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "356e39f48bb74db9a4f2d135909ac0ec"
format_stamp: "Formatted at 2026-08-09 18:56:49 on dist-test-slave-266d"
server_key: "c78d588a266869aa5ac24085b0b17465"
server_key_iv: "be7f98bf42fa5564224209f48b1619ba"
server_key_version: "encryptionkey@0"
I20260809 18:56:49.516206 24939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "356e39f48bb74db9a4f2d135909ac0ec"
format_stamp: "Formatted at 2026-08-09 18:56:49 on dist-test-slave-266d"
server_key: "c78d588a266869aa5ac24085b0b17465"
server_key_iv: "be7f98bf42fa5564224209f48b1619ba"
server_key_version: "encryptionkey@0"
I20260809 18:56:49.520932 24939 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 18:56:49.524122 24962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:49.525441 24939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:49.525607 24939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "356e39f48bb74db9a4f2d135909ac0ec"
format_stamp: "Formatted at 2026-08-09 18:56:49 on dist-test-slave-266d"
server_key: "c78d588a266869aa5ac24085b0b17465"
server_key_iv: "be7f98bf42fa5564224209f48b1619ba"
server_key_version: "encryptionkey@0"
I20260809 18:56:49.525791 24939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:49.557950 24939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:49.558749 24939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:49.559031 24939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:49.576115 24939 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:37295
I20260809 18:56:49.576135 25053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:37295 every 8 connection(s)
I20260809 18:56:49.577401 24939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:49.581115 25058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:49.586411 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 24939
I20260809 18:56:49.586588 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:49.587231 17139 external_mini_cluster.cc:1428] Setting key eda772a00c42438070e86aaf9a9b5e4f
I20260809 18:56:49.593078 25058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec: Bootstrap starting.
I20260809 18:56:49.597136 25058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:49.598356 25058 log.cc:824] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:49.601598 25058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec: No bootstrap required, opened a new log
I20260809 18:56:49.602890 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:49.589130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44616 (local address 127.16.188.254:37295)
0809 18:56:49.590314 (+ 1184us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:49.590329 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:49.590389 (+ 60us) server_negotiation.cc:407] Connection header received
0809 18:56:49.592854 (+ 2465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:49.592883 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:49.593454 (+ 571us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:49.593882 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:49.594403 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:49.596376 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:49.597726 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:49.598762 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:49.598984 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:49.600173 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:49.600184 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:49.600201 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:49.600868 (+ 667us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:49.600977 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:49.601002 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:49.601152 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:49.601367 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 18:56:49.601689 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":384,"threads_started":1}
I20260809 18:56:49.606637 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:49.610384 25058 raft_consensus.cc:348] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356e39f48bb74db9a4f2d135909ac0ec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37295 } }
I20260809 18:56:49.610721 25058 raft_consensus.cc:374] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:49.610812 25058 raft_consensus.cc:729] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356e39f48bb74db9a4f2d135909ac0ec, State: Initialized, Role: FOLLOWER
I20260809 18:56:49.611346 25058 consensus_queue.cc:260] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356e39f48bb74db9a4f2d135909ac0ec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37295 } }
I20260809 18:56:49.611596 25058 raft_consensus.cc:388] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:49.611747 25058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:49.611913 25058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:49.614085 25058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356e39f48bb74db9a4f2d135909ac0ec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37295 } }
I20260809 18:56:49.614568 25058 leader_election.cc:302] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 356e39f48bb74db9a4f2d135909ac0ec; no voters:
I20260809 18:56:49.615201 25058 leader_election.cc:288] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:49.615347 25066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:49.616340 25066 raft_consensus.cc:686] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [term 1 LEADER]: Becoming Leader. State: Replica: 356e39f48bb74db9a4f2d135909ac0ec, State: Running, Role: LEADER
I20260809 18:56:49.616819 25066 consensus_queue.cc:237] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356e39f48bb74db9a4f2d135909ac0ec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37295 } }
I20260809 18:56:49.617264 25058 sys_catalog.cc:564] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:49.619583 25070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 356e39f48bb74db9a4f2d135909ac0ec. Latest consensus state: current_term: 1 leader_uuid: "356e39f48bb74db9a4f2d135909ac0ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356e39f48bb74db9a4f2d135909ac0ec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37295 } } }
I20260809 18:56:49.619625 25068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "356e39f48bb74db9a4f2d135909ac0ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "356e39f48bb74db9a4f2d135909ac0ec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37295 } } }
I20260809 18:56:49.619927 25070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:49.619990 25068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:49.620780 25081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:49.631598 25081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:49.640252 25081 catalog_manager.cc:1347] Generated new cluster ID: 5cf6c754a7a3498d99ec1d70002a6bba
I20260809 18:56:49.640409 25081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:49.660537 25081 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:49.661799 25081 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:49.670526 25081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 356e39f48bb74db9a4f2d135909ac0ec: Generated new TSK 0
I20260809 18:56:49.671417 25081 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 18:56:49.719483 25105 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 18:56:49.719704 25105 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 18:56:49.721666 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:49.699276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.16.188.254:37295)
0809 18:56:49.699497 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:49.699503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:49.700099 (+ 596us) server_negotiation.cc:407] Connection header received
0809 18:56:49.700466 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:49.700470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:49.700539 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:49.700694 (+ 155us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:56:49.701351 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:49.702093 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:49.704122 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:49.704573 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:49.704685 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:49.705304 (+ 619us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:56:49.721170 (+ 15866us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 18:56:49.721442 (+ 272us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44620: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 18:56:49.721788 25063 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44620: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 18:56:49.723847 25104 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:49.699135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37295 (local address 127.0.0.1:44620)
0809 18:56:49.699991 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:49.700010 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:49.700201 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:49.700745 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:49.700751 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:49.700765 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:56:49.701207 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:49.701222 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:49.702236 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:49.702241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:49.703978 (+ 1737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:49.703994 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:49.704737 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:49.704744 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:49.704940 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:49.705019 (+ 79us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:56:49.721436 (+ 16417us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 18:56:49.721817 (+ 381us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.188.254:37295: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":506,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.16.188.254:37295: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 18:56:49.725481 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 24939
I20260809 18:56:49.726627 25045 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:49.818687 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 24939
2026-08-09T18:56:49Z chronyd exiting
I20260809 18:56:49.871199 17139 test_util.cc:175] -----------------------------------------------
I20260809 18:56:49.871322 17139 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301765673554-17139-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (746 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 18:56:49.875059 17139 mini_oidc.cc:152] Starting JWKS server
I20260809 18:56:49.876799 17139 webserver.cc:460] Webserver started at https://127.0.0.1:36385/ using document root <none> and password file <none>
I20260809 18:56:49.877012 17139 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:56:49.877615 17139 webserver.cc:460] Webserver started at http://127.0.0.1:41493/ using document root <none> and password file <none>
2026-08-09T18:56:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:49Z Disabled control of system clock
I20260809 18:56:49.906343 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:41895
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:35235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:41895
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36385/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/testchainca.cert with env {}
W20260809 18:56:50.219722 25117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:50.220069 25117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:50.220214 25117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:50.227689 25117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:50.227840 25117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:50.227912 25117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:50.227989 25117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:50.228048 25117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:56:50.228140 25117 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:56:50.228194 25117 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36385/jwks.json
I20260809 18:56:50.238771 25117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:41895
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:41895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36385/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:50.240218 25117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:50.241654 25117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:50.253337 25125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.253355 25126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.253580 25129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:50.254223 25117 server_base.cc:1034] running on GCE node
I20260809 18:56:50.255100 25117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:50.256605 25117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:50.257823 25117 hybrid_clock.cc:648] HybridClock initialized: now 1786301810257777 us; error 44 us; skew 500 ppm
I20260809 18:56:50.258208 25117 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:56:50.263350 25117 webserver.cc:460] Webserver started at http://127.16.188.254:40005/ using document root <none> and password file <none>
I20260809 18:56:50.264081 25117 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:50.264205 25117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:50.264556 25117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:50.267664 25117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "2e4aead978f948e0b006acf3c6768e53"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-266d"
server_key: "21d7c20ee4620d168b6318bcb7ed8103"
server_key_iv: "61bd58f373bd895657b10be128e70fd6"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.268528 25117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "2e4aead978f948e0b006acf3c6768e53"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-266d"
server_key: "21d7c20ee4620d168b6318bcb7ed8103"
server_key_iv: "61bd58f373bd895657b10be128e70fd6"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.273947 25117 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260809 18:56:50.277333 25135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:50.278667 25117 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 18:56:50.278826 25117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "2e4aead978f948e0b006acf3c6768e53"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-266d"
server_key: "21d7c20ee4620d168b6318bcb7ed8103"
server_key_iv: "61bd58f373bd895657b10be128e70fd6"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.279026 25117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:50.297210 25117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:50.298034 25117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:50.298327 25117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:50.315243 25117 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:41895
I20260809 18:56:50.315266 25212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:41895 every 8 connection(s)
I20260809 18:56:50.316636 25117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:50.320400 25213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:50.322206 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 25117
I20260809 18:56:50.322399 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:50.323017 17139 external_mini_cluster.cc:1428] Setting key 0bfde824ce48273ca14932969dc7ab29
I20260809 18:56:50.331768 25213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53: Bootstrap starting.
I20260809 18:56:50.335145 25213 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:50.336009 25218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:50.324833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46554 (local address 127.16.188.254:41895)
0809 18:56:50.325826 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:50.325836 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:50.325910 (+ 74us) server_negotiation.cc:407] Connection header received
0809 18:56:50.327472 (+ 1562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:50.327493 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:50.327910 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:50.328219 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:50.328812 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.330144 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.331886 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.332529 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.332679 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:50.333859 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:50.333867 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:50.333879 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:50.334364 (+ 485us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:50.334449 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:50.334470 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:50.334559 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:50.334777 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 18:56:50.335069 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":370,"threads_started":1}
I20260809 18:56:50.336128 25213 log.cc:824] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:50.339221 25213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53: No bootstrap required, opened a new log
I20260809 18:56:50.339998 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:50.347627 25213 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4aead978f948e0b006acf3c6768e53" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41895 } }
I20260809 18:56:50.347934 25213 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:50.348007 25213 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e4aead978f948e0b006acf3c6768e53, State: Initialized, Role: FOLLOWER
I20260809 18:56:50.348446 25213 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4aead978f948e0b006acf3c6768e53" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41895 } }
I20260809 18:56:50.348666 25213 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:50.348793 25213 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:50.348984 25213 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:50.351079 25213 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4aead978f948e0b006acf3c6768e53" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41895 } }
I20260809 18:56:50.351521 25213 leader_election.cc:302] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e4aead978f948e0b006acf3c6768e53; no voters:
I20260809 18:56:50.352053 25213 leader_election.cc:288] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:50.352188 25222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:50.352886 25222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [term 1 LEADER]: Becoming Leader. State: Replica: 2e4aead978f948e0b006acf3c6768e53, State: Running, Role: LEADER
I20260809 18:56:50.353392 25222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4aead978f948e0b006acf3c6768e53" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41895 } }
I20260809 18:56:50.353920 25213 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:50.356135 25227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e4aead978f948e0b006acf3c6768e53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4aead978f948e0b006acf3c6768e53" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41895 } } }
I20260809 18:56:50.356110 25229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e4aead978f948e0b006acf3c6768e53. Latest consensus state: current_term: 1 leader_uuid: "2e4aead978f948e0b006acf3c6768e53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4aead978f948e0b006acf3c6768e53" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41895 } } }
I20260809 18:56:50.356936 25227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:50.356964 25229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:50.361814 25235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:50.367215 25235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:50.375685 25235 catalog_manager.cc:1347] Generated new cluster ID: 902acd4f058a4eb3a9fd1b55d0cf7987
I20260809 18:56:50.375772 25235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:50.385049 25235 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:50.386193 25235 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:50.391549 25235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e4aead978f948e0b006acf3c6768e53: Generated new TSK 0
I20260809 18:56:50.392311 25235 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 18:56:50.438176 25271 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 18:56:50.438304 25271 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 18:56:50.439231 25218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:50.413015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46566 (local address 127.16.188.254:41895)
0809 18:56:50.413196 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:50.413203 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:50.413631 (+ 428us) server_negotiation.cc:407] Connection header received
0809 18:56:50.413850 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:50.413854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:50.413916 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:50.414051 (+ 135us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:56:50.414506 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.415234 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.416575 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.417030 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.417163 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:50.417621 (+ 458us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:56:50.438607 (+ 20986us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36385/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 18:56:50.438944 (+ 337us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46566: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36385/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 18:56:50.439363 25218 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46566: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36385/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 18:56:50.439448 25270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:50.412942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:41895 (local address 127.0.0.1:46566)
0809 18:56:50.413529 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:50.413548 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:50.413689 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:50.414081 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:50.414086 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:50.414097 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:56:50.414350 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:50.414360 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.415369 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.415373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:50.416434 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:50.416452 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:50.417226 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:50.417233 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:50.417369 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:50.417401 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:56:50.438809 (+ 21408us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36385/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 18:56:50.439045 (+ 236us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.188.254:41895: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36385/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":329,"threads_started":1}
I20260809 18:56:50.440454 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 25117
I20260809 18:56:50.441586 25206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:50.530519 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 25117
2026-08-09T18:56:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (715 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 18:56:50.590832 17139 mini_oidc.cc:152] Starting JWKS server
I20260809 18:56:50.592787 17139 webserver.cc:460] Webserver started at https://127.0.0.1:33415/ using document root <none> and password file <none>
I20260809 18:56:50.593003 17139 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:56:50.593667 17139 webserver.cc:460] Webserver started at http://127.0.0.1:41873/ using document root <none> and password file <none>
2026-08-09T18:56:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:50Z Disabled control of system clock
I20260809 18:56:50.622766 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:46657
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:46663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:46657
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33415/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 18:56:50.947734 25278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:50.948016 25278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:50.948155 25278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:50.955047 25278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:50.955161 25278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:50.955222 25278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:50.955307 25278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:50.955364 25278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:56:50.955447 25278 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:56:50.955499 25278 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33415/jwks.json
I20260809 18:56:50.964351 25278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:46663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:46657
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:46657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33415/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:50.965611 25278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:50.967356 25278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:50.978528 25288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.978618 25289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:50.978603 25291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:50.979941 25278 server_base.cc:1034] running on GCE node
I20260809 18:56:50.980731 25278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:50.982141 25278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:50.983359 25278 hybrid_clock.cc:648] HybridClock initialized: now 1786301810983313 us; error 37 us; skew 500 ppm
I20260809 18:56:50.983708 25278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:56:50.986022 25278 webserver.cc:460] Webserver started at http://127.16.188.254:45987/ using document root <none> and password file <none>
I20260809 18:56:50.986699 25278 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:50.986811 25278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:50.987147 25278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:50.990219 25278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "05cbaf2999ce459cb9b407a749cd93ab"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-266d"
server_key: "511444ca53cba432ee75596c4c3a97ca"
server_key_iv: "7d2f4af064b470be041c93a1cad1081d"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.991044 25278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "05cbaf2999ce459cb9b407a749cd93ab"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-266d"
server_key: "511444ca53cba432ee75596c4c3a97ca"
server_key_iv: "7d2f4af064b470be041c93a1cad1081d"
server_key_version: "encryptionkey@0"
I20260809 18:56:50.996236 25278 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 18:56:50.999855 25302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.001168 25278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:51.001353 25278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "05cbaf2999ce459cb9b407a749cd93ab"
format_stamp: "Formatted at 2026-08-09 18:56:50 on dist-test-slave-266d"
server_key: "511444ca53cba432ee75596c4c3a97ca"
server_key_iv: "7d2f4af064b470be041c93a1cad1081d"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.001580 25278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:51.027846 25278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:51.028728 25278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:51.029047 25278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:51.047037 25278 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:46657
I20260809 18:56:51.047058 25376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:46657 every 8 connection(s)
I20260809 18:56:51.048349 25278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:51.049495 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 25278
I20260809 18:56:51.049695 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:51.050377 17139 external_mini_cluster.cc:1428] Setting key 7b3e6ee079e18e18c45f73466610bde0
I20260809 18:56:51.052325 25377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.064978 25381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.052203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52714 (local address 127.16.188.254:46657)
0809 18:56:51.053287 (+ 1084us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.053310 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.053364 (+ 54us) server_negotiation.cc:407] Connection header received
0809 18:56:51.055251 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.055285 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.055831 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.056240 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.056753 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.058713 (+ 1960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.060071 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.061025 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.061223 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.062341 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.062352 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.062368 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.063038 (+ 670us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.063131 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.063158 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.063256 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.063494 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.063803 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":369,"threads_started":1}
I20260809 18:56:51.065846 25377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab: Bootstrap starting.
I20260809 18:56:51.068507 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:51.068938 25377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.070096 25377 log.cc:824] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.072821 25377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab: No bootstrap required, opened a new log
I20260809 18:56:51.079630 25377 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05cbaf2999ce459cb9b407a749cd93ab" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 46657 } }
I20260809 18:56:51.079937 25377 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.080006 25377 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cbaf2999ce459cb9b407a749cd93ab, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.080493 25377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05cbaf2999ce459cb9b407a749cd93ab" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 46657 } }
I20260809 18:56:51.080714 25377 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:51.080879 25377 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:51.081053 25377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.083133 25377 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05cbaf2999ce459cb9b407a749cd93ab" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 46657 } }
I20260809 18:56:51.083576 25377 leader_election.cc:302] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05cbaf2999ce459cb9b407a749cd93ab; no voters:
I20260809 18:56:51.084079 25377 leader_election.cc:288] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:51.084216 25384 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:51.084858 25384 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [term 1 LEADER]: Becoming Leader. State: Replica: 05cbaf2999ce459cb9b407a749cd93ab, State: Running, Role: LEADER
I20260809 18:56:51.085387 25384 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05cbaf2999ce459cb9b407a749cd93ab" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 46657 } }
I20260809 18:56:51.085966 25377 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:51.087761 25385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05cbaf2999ce459cb9b407a749cd93ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05cbaf2999ce459cb9b407a749cd93ab" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 46657 } } }
I20260809 18:56:51.088042 25385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:51.088524 25386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05cbaf2999ce459cb9b407a749cd93ab. Latest consensus state: current_term: 1 leader_uuid: "05cbaf2999ce459cb9b407a749cd93ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05cbaf2999ce459cb9b407a749cd93ab" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 46657 } } }
I20260809 18:56:51.088846 25386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:51.092235 25394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:51.097383 25394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:51.105883 25394 catalog_manager.cc:1347] Generated new cluster ID: 372b911343b4433faf872987846a6595
I20260809 18:56:51.105989 25394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:51.122941 25394 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:51.124125 25394 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:51.131925 25394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05cbaf2999ce459cb9b407a749cd93ab: Generated new TSK 0
I20260809 18:56:51.132622 25394 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:56:51.153600 25381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.146268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52726 (local address 127.16.188.254:46657)
0809 18:56:51.146402 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.146406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.146980 (+ 574us) server_negotiation.cc:407] Connection header received
0809 18:56:51.147199 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.147203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.147276 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.147398 (+ 122us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:56:51.147882 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.148577 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.149938 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.150385 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.150494 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.150985 (+ 491us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:56:51.152972 (+ 1987us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33415/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 18:56:51.153322 (+ 350us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52726: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33415/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 18:56:51.153703 25381 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52726: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33415/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 18:56:51.155731 25429 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:51.146333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:46657 (local address 127.0.0.1:52726)
0809 18:56:51.146884 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.146899 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.147032 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.147428 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.147433 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.147445 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:56:51.147728 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.147737 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.148711 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.148716 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.149797 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.149809 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.150566 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.150572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.150703 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.150735 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:56:51.153204 (+ 2469us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33415/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 18:56:51.155277 (+ 2073us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.188.254:46657: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33415/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":1782,"thread_start_us":310,"threads_started":1}
I20260809 18:56:51.156898 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 25278
I20260809 18:56:51.157967 25367 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 18:56:51.169283 25430 webserver.cc:533] Webserver: sslize failed:
E20260809 18:56:51.169394 25430 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 18:56:51.248057 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 25278
2026-08-09T18:56:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (716 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T18:56:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:51Z Disabled control of system clock
I20260809 18:56:51.335532 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:43019
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:43019
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/testchainca.cert with env {}
W20260809 18:56:51.656322 25436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:51.656587 25436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:51.656670 25436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:51.663582 25436 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:51.663673 25436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:51.663709 25436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:51.663766 25436 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:51.663808 25436 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:56:51.663867 25436 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:56:51.663905 25436 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 18:56:51.673396 25436 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:43019
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:43019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:51.674562 25436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:51.675748 25436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:51.686551 25444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:51.686718 25448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:51.686717 25443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:51.687871 25436 server_base.cc:1034] running on GCE node
I20260809 18:56:51.688549 25436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:51.689841 25436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:51.691040 25436 hybrid_clock.cc:648] HybridClock initialized: now 1786301811690992 us; error 40 us; skew 500 ppm
I20260809 18:56:51.691424 25436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:56:51.693511 25436 webserver.cc:460] Webserver started at http://127.16.188.254:42627/ using document root <none> and password file <none>
I20260809 18:56:51.694121 25436 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:51.694226 25436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:51.694497 25436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:51.697507 25436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "ad1a3be4d71a4c13acae19519e664c94"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-266d"
server_key: "acc116ac568ae24bdc968457bd9faf9e"
server_key_iv: "c53ca2542d9d797f0d9efb8020ccdb20"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.698436 25436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "ad1a3be4d71a4c13acae19519e664c94"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-266d"
server_key: "acc116ac568ae24bdc968457bd9faf9e"
server_key_iv: "c53ca2542d9d797f0d9efb8020ccdb20"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.703214 25436 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 18:56:51.706288 25461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:51.707477 25436 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:56:51.707615 25436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "ad1a3be4d71a4c13acae19519e664c94"
format_stamp: "Formatted at 2026-08-09 18:56:51 on dist-test-slave-266d"
server_key: "acc116ac568ae24bdc968457bd9faf9e"
server_key_iv: "c53ca2542d9d797f0d9efb8020ccdb20"
server_key_version: "encryptionkey@0"
I20260809 18:56:51.707799 25436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:51.721966 25436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:51.722649 25436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:51.722900 25436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:51.738466 25436 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:43019
I20260809 18:56:51.738483 25537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:43019 every 8 connection(s)
I20260809 18:56:51.739638 25436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:51.741966 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 25436
I20260809 18:56:51.742184 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:51.743021 17139 external_mini_cluster.cc:1428] Setting key 86eb3c867ca0c861f6bcae7d97b585b4
I20260809 18:56:51.743546 25538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:51.756070 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.744763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52686 (local address 127.16.188.254:43019)
0809 18:56:51.745667 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.745677 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.745717 (+ 40us) server_negotiation.cc:407] Connection header received
0809 18:56:51.747791 (+ 2074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.747811 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.748233 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.748538 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:51.749130 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.750431 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.752115 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.752718 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.752852 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.754001 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:51.754008 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:51.754020 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:56:51.754548 (+ 528us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:51.754623 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:56:51.754643 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:51.754723 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:51.754932 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 18:56:51.755226 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":347,"threads_started":1}
I20260809 18:56:51.756325 25538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94: Bootstrap starting.
I20260809 18:56:51.759793 25538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:51.759853 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:56:51.760953 25538 log.cc:824] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:51.763801 25538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94: No bootstrap required, opened a new log
I20260809 18:56:51.770601 25538 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad1a3be4d71a4c13acae19519e664c94" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43019 } }
I20260809 18:56:51.770910 25538 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:51.770979 25538 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1a3be4d71a4c13acae19519e664c94, State: Initialized, Role: FOLLOWER
I20260809 18:56:51.771423 25538 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad1a3be4d71a4c13acae19519e664c94" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43019 } }
I20260809 18:56:51.771624 25538 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:51.771720 25538 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:51.771835 25538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:51.773805 25538 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad1a3be4d71a4c13acae19519e664c94" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43019 } }
I20260809 18:56:51.774222 25538 leader_election.cc:302] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad1a3be4d71a4c13acae19519e664c94; no voters:
I20260809 18:56:51.774749 25538 leader_election.cc:288] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:51.774904 25546 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:51.775573 25546 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [term 1 LEADER]: Becoming Leader. State: Replica: ad1a3be4d71a4c13acae19519e664c94, State: Running, Role: LEADER
I20260809 18:56:51.776141 25546 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad1a3be4d71a4c13acae19519e664c94" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43019 } }
I20260809 18:56:51.776788 25538 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:51.779060 25551 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad1a3be4d71a4c13acae19519e664c94. Latest consensus state: current_term: 1 leader_uuid: "ad1a3be4d71a4c13acae19519e664c94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad1a3be4d71a4c13acae19519e664c94" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43019 } } }
I20260809 18:56:51.779137 25549 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad1a3be4d71a4c13acae19519e664c94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad1a3be4d71a4c13acae19519e664c94" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 43019 } } }
I20260809 18:56:51.779491 25551 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:51.780177 25549 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:51.781014 25558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:51.786177 25558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:51.794579 25558 catalog_manager.cc:1347] Generated new cluster ID: 7cfef595ae2a472784ad6d2f3b935105
I20260809 18:56:51.794678 25558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:51.826802 25558 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:51.828105 25558 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:51.836464 25558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad1a3be4d71a4c13acae19519e664c94: Generated new TSK 0
I20260809 18:56:51.837293 25558 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:56:51.907536 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:51.851256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52688 (local address 127.16.188.254:43019)
0809 18:56:51.851449 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:51.851455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:51.851838 (+ 383us) server_negotiation.cc:407] Connection header received
0809 18:56:51.852053 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:51.852056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:51.852133 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:51.852252 (+ 119us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:56:51.852726 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.853488 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.855505 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.855951 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.856042 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.856662 (+ 620us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:56:51.906944 (+ 50282us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 18:56:51.907299 (+ 355us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52688: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 18:56:51.907668 25544 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52688: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 18:56:51.907996 25577 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:51.851113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:43019 (local address 127.0.0.1:52688)
0809 18:56:51.851726 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:51.851746 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:51.851904 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:51.852284 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:51.852289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:51.852302 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:56:51.852587 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.852599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.853624 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.853630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.855355 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:51.855372 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:51.856123 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:51.856131 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:51.856353 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:51.856401 (+ 48us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:56:51.907251 (+ 50850us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 18:56:51.907575 (+ 324us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.188.254:43019: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":283,"threads_started":1}
I20260809 18:56:51.909365 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 25436
I20260809 18:56:51.910599 25532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:52.007647 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 25436
2026-08-09T18:56:52Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (740 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (403 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (403 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:52 dist-test-slave-266d krb5kdc[25603](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:52 dist-test-slave-266d krb5kdc[25603](info): set up 2 sockets
Aug 09 18:56:52 dist-test-slave-266d krb5kdc[25603](info): commencing operation
krb5kdc: starting...
W20260809 18:56:54.007385 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:54 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:56:54.210273 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:38421
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:34949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:38421
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:54.523748 25626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:54.524014 25626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:54.524139 25626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:54.531003 25626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:54.531095 25626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:54.531173 25626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:54.531245 25626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:54.531306 25626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:54.540601 25626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:34949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:38421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:38421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:54.541792 25626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:54.543025 25626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:54.553895 25635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:54.553857 25640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:54.553920 25636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:54.554880 25626 server_base.cc:1034] running on GCE node
I20260809 18:56:54.555555 25626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:54.556834 25626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:54.558046 25626 hybrid_clock.cc:648] HybridClock initialized: now 1786301814557948 us; error 84 us; skew 500 ppm
I20260809 18:56:54.558353 25626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:54 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301814, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:54.561210 25626 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:56:54.562564 25626 webserver.cc:460] Webserver started at http://127.16.188.254:33269/ using document root <none> and password file <none>
I20260809 18:56:54.563180 25626 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:54.563292 25626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:54.563583 25626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:54.566387 25626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "bf171b565d5d4e95a82177f63505322a"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-266d"
server_key: "051211e5c628742039b4a9e5978312ff"
server_key_iv: "afcf2d1a065e4411b7ae12e42d07fd2d"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.567147 25626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "bf171b565d5d4e95a82177f63505322a"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-266d"
server_key: "051211e5c628742039b4a9e5978312ff"
server_key_iv: "afcf2d1a065e4411b7ae12e42d07fd2d"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.572710 25626 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 18:56:54.576540 25649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:54.577797 25626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:56:54.577950 25626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "bf171b565d5d4e95a82177f63505322a"
format_stamp: "Formatted at 2026-08-09 18:56:54 on dist-test-slave-266d"
server_key: "051211e5c628742039b4a9e5978312ff"
server_key_iv: "afcf2d1a065e4411b7ae12e42d07fd2d"
server_key_version: "encryptionkey@0"
I20260809 18:56:54.578119 25626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:54.597321 25626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:54.600752 25626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:54.601001 25626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:54.617602 25626 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:38421
I20260809 18:56:54.617650 25732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:38421 every 8 connection(s)
I20260809 18:56:54.618885 25626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:54.622483 25734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:54.627728 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 25626
I20260809 18:56:54.627959 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:54.628774 17139 external_mini_cluster.cc:1428] Setting key 2f383bcfec025e0a139e83cfbda938d5
I20260809 18:56:54.633558 25734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a: Bootstrap starting.
I20260809 18:56:54.636418 25734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:54.637406 25734 log.cc:824] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:54.640281 25734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a: No bootstrap required, opened a new log
Aug 09 18:56:54 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:54.649784 25734 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf171b565d5d4e95a82177f63505322a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38421 } }
I20260809 18:56:54.650207 25734 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:54.650324 25734 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf171b565d5d4e95a82177f63505322a, State: Initialized, Role: FOLLOWER
I20260809 18:56:54.650959 25734 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf171b565d5d4e95a82177f63505322a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38421 } }
I20260809 18:56:54.651136 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:54.630916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57546 (local address 127.16.188.254:38421)
0809 18:56:54.631702 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:54.631713 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:54.631754 (+ 41us) server_negotiation.cc:407] Connection header received
0809 18:56:54.633406 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:54.633428 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:54.633812 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:54.634135 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:54.635483 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:54.636766 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:54.638133 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:54.638960 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:54.639138 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:54.642974 (+ 3836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:54.642984 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:54.643006 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:54.643053 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:54.646907 (+ 3854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:54.647521 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:54.647533 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:54.647541 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:54.647752 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:54.648068 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:54.648073 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:54.648077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:54.648784 (+ 707us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:54.649073 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:54.649383 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 18:56:54.649816 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":366,"threads_started":1}
I20260809 18:56:54.651268 25734 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:54.651455 25734 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:54.651640 25734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:54.653843 25734 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf171b565d5d4e95a82177f63505322a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38421 } }
I20260809 18:56:54.654289 25734 leader_election.cc:302] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf171b565d5d4e95a82177f63505322a; no voters:
I20260809 18:56:54.654788 25734 leader_election.cc:288] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:54.654915 25742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:54.655663 25742 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [term 1 LEADER]: Becoming Leader. State: Replica: bf171b565d5d4e95a82177f63505322a, State: Running, Role: LEADER
I20260809 18:56:54.656163 25742 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf171b565d5d4e95a82177f63505322a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38421 } }
I20260809 18:56:54.656776 25734 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:54.659089 25744 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf171b565d5d4e95a82177f63505322a. Latest consensus state: current_term: 1 leader_uuid: "bf171b565d5d4e95a82177f63505322a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf171b565d5d4e95a82177f63505322a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38421 } } }
I20260809 18:56:54.659060 25743 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf171b565d5d4e95a82177f63505322a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf171b565d5d4e95a82177f63505322a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38421 } } }
I20260809 18:56:54.659914 25744 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:54.659972 25743 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:54.661681 25749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:54.666518 25749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:54.675549 25749 catalog_manager.cc:1347] Generated new cluster ID: b9d591dec0a048dea12f4c2232dd62e6
I20260809 18:56:54.675673 25749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:54.683069 25749 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:54.684440 25749 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:54.694355 25749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf171b565d5d4e95a82177f63505322a: Generated new TSK 0
I20260809 18:56:54.695245 25749 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:56:54.747709 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38421
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:34949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:55.065578 25776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:55.065852 25776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:55.065972 25776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:55.072880 25776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:55.072973 25776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:55.073103 25776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:55.082386 25776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:34949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38421
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:55.083500 25776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:55.084685 25776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:55.096855 25782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:55.096815 25788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:55.096897 25785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:55.097740 25776 server_base.cc:1034] running on GCE node
I20260809 18:56:55.098310 25776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:55.099133 25776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:55.100330 25776 hybrid_clock.cc:648] HybridClock initialized: now 1786301815100279 us; error 46 us; skew 500 ppm
I20260809 18:56:55.100601 25776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:55 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.103524 25776 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:56:55.104918 25776 webserver.cc:460] Webserver started at http://127.16.188.193:46713/ using document root <none> and password file <none>
I20260809 18:56:55.105552 25776 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:55.105661 25776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:55.105942 25776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:55.108644 25776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "6d64d91d7ef64656a1950ca3b0fe6eef"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-266d"
server_key: "42b34ad69a4972d884f45b5a70cdc965"
server_key_iv: "725c71649d3b4a1a1bc28b68ea0025aa"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.109414 25776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "6d64d91d7ef64656a1950ca3b0fe6eef"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-266d"
server_key: "42b34ad69a4972d884f45b5a70cdc965"
server_key_iv: "725c71649d3b4a1a1bc28b68ea0025aa"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.114080 25776 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 18:56:55.117282 25799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.118445 25776 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 18:56:55.118594 25776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "6d64d91d7ef64656a1950ca3b0fe6eef"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-266d"
server_key: "42b34ad69a4972d884f45b5a70cdc965"
server_key_iv: "725c71649d3b4a1a1bc28b68ea0025aa"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.118772 25776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:55.147109 25776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:55.151580 25776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:55.151862 25776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:55.152849 25776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:55.154217 25776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:55.154302 25776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.154419 25776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:55.154470 25776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.183972 25776 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:45595
I20260809 18:56:55.184036 25981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:45595 every 8 connection(s)
I20260809 18:56:55.185227 25776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:55.185798 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 25776
I20260809 18:56:55.185994 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:55.186810 17139 external_mini_cluster.cc:1428] Setting key 689960fcb06358f2aede71705ae7e34f
Aug 09 18:56:55 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:55.204378 25985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.187767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:54249 (local address 127.16.188.254:38421)
0809 18:56:55.188198 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.188203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.189329 (+ 1126us) server_negotiation.cc:407] Connection header received
0809 18:56:55.191072 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.191077 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.191154 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.191247 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.192674 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.193440 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.195135 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.195534 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.195653 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.199138 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:55.199142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:55.199146 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:55.199176 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:55.201633 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.202281 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.202286 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.202290 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.202405 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.202794 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.202799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.202802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.203068 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:55.203204 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:55.203811 (+ 607us) server_negotiation.cc:299] Negotiation successful
0809 18:56:55.204023 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":223,"threads_started":1}
I20260809 18:56:55.205314 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.188390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38421 (local address 127.16.188.193:54249)
0809 18:56:55.189187 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:55.189225 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:55.190817 (+ 1592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:55.191482 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:55.191490 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:55.191972 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:55.192503 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:55.192519 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.193592 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.193596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:55.194997 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:55.195010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.195751 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.195759 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:55.195963 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.196637 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:55.196666 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:55.198934 (+ 2268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:55.201755 (+ 2821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.201764 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.201778 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.202171 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.202507 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.202513 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.202516 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.202687 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.203190 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:55.203197 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:55.203484 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 18:56:55.203708 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 18:56:55.204184 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":316,"threads_started":1}
I20260809 18:56:55.206734 25982 heartbeater.cc:347] Connected to a master server at 127.16.188.254:38421
I20260809 18:56:55.207002 25982 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:55.207657 25982 heartbeater.cc:511] Master 127.16.188.254:38421 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
I20260809 18:56:55.209623 25678 ts_manager.cc:194] Registered new tserver with Master: 6d64d91d7ef64656a1950ca3b0fe6eef (127.16.188.193:45595)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
I20260809 18:56:55.211017 25678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:54249
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:56:55.233505 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38421
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:34949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:55.546469 25989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:55.546736 25989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:55.546828 25989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:55.553737 25989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:55.553828 25989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:55.553941 25989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:55.563033 25989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:34949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38421
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:55.564158 25989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:55.565445 25989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:55.577549 25996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:55.577633 25994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:55.577600 25998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:55.578303 25989 server_base.cc:1034] running on GCE node
I20260809 18:56:55.578837 25989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:55.579710 25989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:55.580914 25989 hybrid_clock.cc:648] HybridClock initialized: now 1786301815580860 us; error 37 us; skew 500 ppm
I20260809 18:56:55.581269 25989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:55 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:55.587567 25989 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:56:55.588912 25989 webserver.cc:460] Webserver started at http://127.16.188.194:43217/ using document root <none> and password file <none>
I20260809 18:56:55.589561 25989 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:55.589690 25989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:55.589975 25989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:55.592684 25989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "7776a761df784c8d99fdb3480f513d10"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-266d"
server_key: "197a75043e589dfa4a82786071e85887"
server_key_iv: "771d8c2071d248ebbd6247fa1c441be7"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.593447 25989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "7776a761df784c8d99fdb3480f513d10"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-266d"
server_key: "197a75043e589dfa4a82786071e85887"
server_key_iv: "771d8c2071d248ebbd6247fa1c441be7"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.598182 25989 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 18:56:55.601364 26008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.602530 25989 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 18:56:55.602681 25989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "7776a761df784c8d99fdb3480f513d10"
format_stamp: "Formatted at 2026-08-09 18:56:55 on dist-test-slave-266d"
server_key: "197a75043e589dfa4a82786071e85887"
server_key_iv: "771d8c2071d248ebbd6247fa1c441be7"
server_key_version: "encryptionkey@0"
I20260809 18:56:55.602859 25989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:55.624425 25989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:55.628252 25989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:55.628499 25989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:55.629415 25989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:55.630641 25989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:55.630721 25989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.630839 25989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:55.630892 25989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:55.661271 25989 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:41797
I20260809 18:56:55.661315 26187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:41797 every 8 connection(s)
I20260809 18:56:55.662463 25989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:55.672345 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 25989
I20260809 18:56:55.672544 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:55.672999 17139 external_mini_cluster.cc:1428] Setting key 33505f2e1472b7d060a8524a5bc272ad
Aug 09 18:56:55 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301815, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:55.681299 25985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.664811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:47639 (local address 127.16.188.254:38421)
0809 18:56:55.664979 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:55.664983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:55.666181 (+ 1198us) server_negotiation.cc:407] Connection header received
0809 18:56:55.667969 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:55.667974 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:55.668057 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:55.668147 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:55.669647 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.670406 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.671893 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.672444 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.672586 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.676027 (+ 3441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:55.676031 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:55.676034 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:55.676064 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:55.678454 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.679233 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.679236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.679239 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.679354 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:55.679771 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:55.679773 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:55.679775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:55.680003 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:55.680113 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:55.680841 (+ 728us) server_negotiation.cc:299] Negotiation successful
0809 18:56:55.681001 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 18:56:55.682456 26194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:55.665316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38421 (local address 127.16.188.194:47639)
0809 18:56:55.666015 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:55.666053 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:55.667713 (+ 1660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:55.668371 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:55.668378 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:55.668848 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:55.669467 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:55.669492 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.670558 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.670562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:55.671744 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:55.671758 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:55.672661 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:55.672669 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:55.672870 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:55.673448 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:55.673470 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:55.675820 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:55.678588 (+ 2768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.678596 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.678609 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.679135 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.679444 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:55.679448 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:55.679451 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:55.679674 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:55.680118 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:55.680125 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:55.680484 (+ 359us) client_negotiation.cc:769] Sending connection context
0809 18:56:55.680748 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 18:56:55.681259 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":281,"threads_started":1}
I20260809 18:56:55.683703 26190 heartbeater.cc:347] Connected to a master server at 127.16.188.254:38421
I20260809 18:56:55.683997 26190 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:55.684702 26190 heartbeater.cc:511] Master 127.16.188.254:38421 requested a full tablet report, sending...
I20260809 18:56:55.686113 25678 ts_manager.cc:194] Registered new tserver with Master: 7776a761df784c8d99fdb3480f513d10 (127.16.188.194:41797)
I20260809 18:56:55.687098 25678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:47639
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:56:55.721395 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38421
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:34949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:56.032032 26197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:56.032292 26197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:56.032421 26197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:56.039397 26197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:56.039494 26197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:56.039647 26197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:56:56.048818 26197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:34949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38421
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:56.049993 26197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:56.051209 26197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:56.063558 26203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:56.063527 26209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:56.063756 26207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:56.064442 26197 server_base.cc:1034] running on GCE node
I20260809 18:56:56.065023 26197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:56.066041 26197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:56.067265 26197 hybrid_clock.cc:648] HybridClock initialized: now 1786301816067208 us; error 41 us; skew 500 ppm
I20260809 18:56:56.067549 26197 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.070688 26197 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:56:56.072154 26197 webserver.cc:460] Webserver started at http://127.16.188.195:33835/ using document root <none> and password file <none>
I20260809 18:56:56.073036 26197 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:56.073232 26197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:56.073618 26197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:56.077786 26197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "6dc3eb80bf734bcf99ff8f3e7b1d578e"
format_stamp: "Formatted at 2026-08-09 18:56:56 on dist-test-slave-266d"
server_key: "984707b671c183cfa0a0864bb1e9a7fe"
server_key_iv: "4b8a92ccc7ae6265ec049b50b336d41a"
server_key_version: "encryptionkey@0"
I20260809 18:56:56.078886 26197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "6dc3eb80bf734bcf99ff8f3e7b1d578e"
format_stamp: "Formatted at 2026-08-09 18:56:56 on dist-test-slave-266d"
server_key: "984707b671c183cfa0a0864bb1e9a7fe"
server_key_iv: "4b8a92ccc7ae6265ec049b50b336d41a"
server_key_version: "encryptionkey@0"
I20260809 18:56:56.085501 26197 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 18:56:56.090034 26221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:56.091346 26197 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260809 18:56:56.091507 26197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "6dc3eb80bf734bcf99ff8f3e7b1d578e"
format_stamp: "Formatted at 2026-08-09 18:56:56 on dist-test-slave-266d"
server_key: "984707b671c183cfa0a0864bb1e9a7fe"
server_key_iv: "4b8a92ccc7ae6265ec049b50b336d41a"
server_key_version: "encryptionkey@0"
I20260809 18:56:56.091713 26197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:56.112672 26197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:56.117165 26197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:56.117441 26197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:56.118386 26197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:56.119678 26197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:56.119750 26197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:56.119870 26197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:56.119920 26197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:56.151167 26197 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:43313
I20260809 18:56:56.151199 26402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:43313 every 8 connection(s)
I20260809 18:56:56.152690 26197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:56:56.158924 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 26197
I20260809 18:56:56.159093 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:56:56.159507 17139 external_mini_cluster.cc:1428] Setting key b26d2d9c5beba9e58a8aac619bc38dd4
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:56:56.170993 25985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.155139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:49377 (local address 127.16.188.254:38421)
0809 18:56:56.155342 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.155347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.156533 (+ 1186us) server_negotiation.cc:407] Connection header received
0809 18:56:56.158323 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.158329 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.158414 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.158501 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.160019 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.160894 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.162412 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.162816 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.162923 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.166189 (+ 3266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:56.166194 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:56.166197 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:56.166229 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:56.168505 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.169197 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.169201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.169203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.169325 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.169691 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.169694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.169695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.169941 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:56.170047 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:56.170586 (+ 539us) server_negotiation.cc:299] Negotiation successful
0809 18:56:56.170753 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:56:56.171877 26410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.155640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38421 (local address 127.16.188.195:49377)
0809 18:56:56.156372 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:56.156416 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:56.158073 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:56.158738 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:56.158746 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:56.159289 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:56.159858 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:56.159875 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.161042 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.161047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:56.162277 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:56.162290 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.163029 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.163036 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:56.163274 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.163824 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:56.163850 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:56.166018 (+ 2168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:56.168641 (+ 2623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:56.168647 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:56.168657 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:56.169059 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:56.169403 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:56.169406 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:56.169408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:56.169589 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:56.170028 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:56.170033 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:56.170314 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 18:56:56.170517 (+ 203us) client_negotiation.cc:240] Negotiation successful
0809 18:56:56.170881 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":286,"threads_started":1}
I20260809 18:56:56.173199 26407 heartbeater.cc:347] Connected to a master server at 127.16.188.254:38421
I20260809 18:56:56.173501 26407 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:56.174328 26407 heartbeater.cc:511] Master 127.16.188.254:38421 requested a full tablet report, sending...
I20260809 18:56:56.175565 25678 ts_manager.cc:194] Registered new tserver with Master: 6dc3eb80bf734bcf99ff8f3e7b1d578e (127.16.188.195:43313)
I20260809 18:56:56.176357 25678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:49377
I20260809 18:56:56.186338 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/test-admin.keytab.
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.213693 25982 heartbeater.cc:503] Master 127.16.188.254:38421 was elected leader, sending a full tablet report...
I20260809 18:56:56.214512 17139 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 18:56:56.219367 26415 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:56.217084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54338 (local address 127.16.188.193:45595)
0809 18:56:56.217728 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.217735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.217760 (+ 25us) server_negotiation.cc:407] Connection header received
0809 18:56:56.217811 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.217817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.218014 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.218142 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.219007 (+ 865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54338: BlockingRecv error: recv got EOF from 127.0.0.1:54338 (error 108)
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":330,"threads_started":1}
W20260809 18:56:56.219455 17139 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc' of type FILE
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.221347 17139 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.222810 17139 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:56.236992 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.224317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54340 (local address 127.16.188.193:45595)
0809 18:56:56.224499 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.224506 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.224759 (+ 253us) server_negotiation.cc:407] Connection header received
0809 18:56:56.224923 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.224927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.224983 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.225060 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.226028 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.226967 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.228174 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.228732 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.228824 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.232128 (+ 3304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:56.232138 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:56.232153 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:56.232183 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:56.234801 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.235309 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.235315 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.235317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.235427 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.235698 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.235701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.235702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.236015 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:56.236242 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:56.236484 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 18:56:56.236715 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 18:56:56.242084 26415 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:56.240513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54354 (local address 127.16.188.193:45595)
0809 18:56:56.240692 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.240697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.240895 (+ 198us) server_negotiation.cc:407] Connection header received
0809 18:56:56.241040 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.241045 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.241133 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.241213 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.241854 (+ 641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54354: BlockingRecv error: recv got EOF from 127.0.0.1:54354 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 18:56:56.242494 17139 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc)
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.243834 17139 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.244962 17139 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:56.257556 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.246140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54356 (local address 127.16.188.193:45595)
0809 18:56:56.246306 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.246311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.246553 (+ 242us) server_negotiation.cc:407] Connection header received
0809 18:56:56.246692 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.246698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.246754 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.246826 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.247680 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.248345 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.249521 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.249947 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.250065 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.253122 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:56.253129 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:56.253135 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:56.253183 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:56.255323 (+ 2140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.255871 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.255877 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.255880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.255995 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.256337 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.256342 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.256345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.256589 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:56.256822 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:56.257117 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 18:56:56.257313 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 18:56:56.261027 26415 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:56:56.259680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54362 (local address 127.16.188.193:45595)
0809 18:56:56.259856 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.259862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.260060 (+ 198us) server_negotiation.cc:407] Connection header received
0809 18:56:56.260150 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.260153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.260212 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.260282 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.260831 (+ 549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54362: BlockingRecv error: recv got EOF from 127.0.0.1:54362 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 18:56:56.261247 17139 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301765673554-17139-0/krb5kdc/krb5cc)
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.262529 17139 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:56.263654 17139 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:56:56.276026 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.264818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54372 (local address 127.16.188.193:45595)
0809 18:56:56.264974 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.264979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.265129 (+ 150us) server_negotiation.cc:407] Connection header received
0809 18:56:56.265258 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.265261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.265308 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.265378 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.266219 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.266949 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.268041 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.268435 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.268518 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.271513 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:56.271517 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:56.271520 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:56.271548 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:56.273776 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.274348 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.274352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.274354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.274493 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.274827 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.274830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.274832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.275071 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:56.275359 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:56.275567 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 18:56:56.275769 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:56:56.277432 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 25776
I20260809 18:56:56.287449 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.278051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54374 (local address 127.16.188.193:45595)
0809 18:56:56.278185 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.278189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.278539 (+ 350us) server_negotiation.cc:407] Connection header received
0809 18:56:56.278649 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.278653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.278698 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.278770 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.279522 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.280128 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.281216 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.281700 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.281789 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.283523 (+ 1734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:56.283527 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:56.283530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:56.283556 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:56.285612 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.286123 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.286126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.286128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.286241 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.286506 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.286508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.286510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.286709 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:56.286877 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:56.287078 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 18:56:56.287212 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:56:56.287927 25972 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:56.369781 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 25776
I20260809 18:56:56.393329 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 25989
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:56:56.408169 26432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.394176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37184 (local address 127.16.188.194:41797)
0809 18:56:56.394764 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.394771 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.394799 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:56:56.394862 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.394869 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.395074 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.395211 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.396247 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.397298 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.398447 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.399001 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.399141 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.402749 (+ 3608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:56.402760 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:56.402775 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:56.402814 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:56.405480 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.406142 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.406150 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.406152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.406288 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.406641 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.406646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.406649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.406982 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:56.407290 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:56.407599 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 18:56:56.407854 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":295,"threads_started":1}
I20260809 18:56:56.409415 26178 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:56.491761 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 25989
I20260809 18:56:56.510720 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 26197
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[25603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:56:56.525532 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:56.511717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37762 (local address 127.16.188.195:43313)
0809 18:56:56.512330 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:56.512337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:56.512367 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:56:56.512428 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:56.512434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:56.512679 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:56.512800 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:56.513832 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.514859 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.516015 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:56.516613 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:56.516711 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:56.520551 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:56.520563 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:56.520578 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:56.520618 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:56.523155 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.523746 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.523752 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.523755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.523875 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:56.524144 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:56.524147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:56.524149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:56.524470 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:56.524694 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:56.524883 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 18:56:56.525242 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":306,"threads_started":1}
I20260809 18:56:56.526723 26398 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:56.608341 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 26197
I20260809 18:56:56.631296 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 25626
I20260809 18:56:56.632478 25727 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:56:56.735895 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 25626
2026-08-09T18:56:56Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3923 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[26439](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[26439](info): set up 2 sockets
Aug 09 18:56:56 dist-test-slave-266d krb5kdc[26439](info): commencing operation
krb5kdc: starting...
W20260809 18:56:57.980748 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:56:58 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:56:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:56:58Z Disabled control of system clock
WARNING: no policy specified for oryx/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.254.keytab.
Entry for principal oryx/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.254.keytab.
I20260809 18:56:58.196280 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:33951
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.254.keytab
--principal=oryx/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:33951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:58.516798 26458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:58.517125 26458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:58.517273 26458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:58.524237 26458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:56:58.524354 26458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:58.524433 26458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:58.524508 26458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:56:58.524569 26458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:56:58.534318 26458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:33951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.254.keytab
--principal=oryx/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:33951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:58.535646 26458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:58.536974 26458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:58.548195 26465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.548157 26466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:58.548141 26468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:58.549113 26458 server_base.cc:1034] running on GCE node
I20260809 18:56:58.549861 26458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:58.551148 26458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:58.552357 26458 hybrid_clock.cc:648] HybridClock initialized: now 1786301818552304 us; error 41 us; skew 500 ppm
I20260809 18:56:58.552676 26458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:58 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:58.555655 26458 init.cc:377] Logged in from keytab as oryx/127.16.188.254@KRBTEST.COM (short username oryx)
I20260809 18:56:58.557061 26458 webserver.cc:460] Webserver started at http://127.16.188.254:42611/ using document root <none> and password file <none>
I20260809 18:56:58.557760 26458 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:58.557878 26458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:58.558158 26458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:58.561010 26458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "468a04419f064f3b8a267c0cd9990914"
format_stamp: "Formatted at 2026-08-09 18:56:58 on dist-test-slave-266d"
server_key: "88c94e24730329d5c71ababca970a93a"
server_key_iv: "2f5e261cbcd01a39439da0c5339ddf14"
server_key_version: "encryptionkey@0"
I20260809 18:56:58.561800 26458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "468a04419f064f3b8a267c0cd9990914"
format_stamp: "Formatted at 2026-08-09 18:56:58 on dist-test-slave-266d"
server_key: "88c94e24730329d5c71ababca970a93a"
server_key_iv: "2f5e261cbcd01a39439da0c5339ddf14"
server_key_version: "encryptionkey@0"
I20260809 18:56:58.566771 26458 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:56:58.569980 26481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:58.571174 26458 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:56:58.571341 26458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "468a04419f064f3b8a267c0cd9990914"
format_stamp: "Formatted at 2026-08-09 18:56:58 on dist-test-slave-266d"
server_key: "88c94e24730329d5c71ababca970a93a"
server_key_iv: "2f5e261cbcd01a39439da0c5339ddf14"
server_key_version: "encryptionkey@0"
I20260809 18:56:58.571514 26458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:58.598654 26458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:58.603032 26458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:58.603312 26458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:58.620169 26458 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:33951
I20260809 18:56:58.620203 26563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:33951 every 8 connection(s)
I20260809 18:56:58.621520 26458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:56:58.622786 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 26458
I20260809 18:56:58.623013 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:56:58.623925 17139 external_mini_cluster.cc:1428] Setting key a2e3640e592903ffed309096835a8310
I20260809 18:56:58.625869 26564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:56:58.636636 26564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: Bootstrap starting.
Aug 09 18:56:58 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:56:58.639809 26564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: Neither blocks nor log segments found. Creating new log.
I20260809 18:56:58.640794 26564 log.cc:824] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: Log is configured to *not* fsync() on all Append() calls
I20260809 18:56:58.643404 26564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: No bootstrap required, opened a new log
I20260809 18:56:58.644593 26570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:58.626032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53964 (local address 127.16.188.254:33951)
0809 18:56:58.626770 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:58.626782 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:58.626821 (+ 39us) server_negotiation.cc:407] Connection header received
0809 18:56:58.628345 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:58.628365 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:58.628722 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:58.629064 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:58.630542 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.631837 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.633048 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:58.633745 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:58.633915 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:58.637837 (+ 3922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:58.637845 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:58.637857 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:58.637898 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:58.640707 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.641486 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.641492 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.641498 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.641665 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:58.642066 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:58.642070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:58.642072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:58.642560 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:58.642866 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:58.643279 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 18:56:58.643667 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":318,"threads_started":1}
I20260809 18:56:58.651080 26564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } }
I20260809 18:56:58.651399 26564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:56:58.651489 26564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 468a04419f064f3b8a267c0cd9990914, State: Initialized, Role: FOLLOWER
I20260809 18:56:58.652061 26564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } }
I20260809 18:56:58.652333 26564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:56:58.652495 26564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:56:58.652669 26564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:56:58.654773 26564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } }
I20260809 18:56:58.655244 26564 leader_election.cc:302] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 468a04419f064f3b8a267c0cd9990914; no voters:
I20260809 18:56:58.655807 26564 leader_election.cc:288] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:56:58.655946 26573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:56:58.657156 26573 raft_consensus.cc:686] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 1 LEADER]: Becoming Leader. State: Replica: 468a04419f064f3b8a267c0cd9990914, State: Running, Role: LEADER
I20260809 18:56:58.657675 26573 consensus_queue.cc:237] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } }
I20260809 18:56:58.657814 26564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:56:58.660377 26576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 468a04419f064f3b8a267c0cd9990914. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } }
I20260809 18:56:58.660744 26576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.661338 26575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } }
I20260809 18:56:58.661641 26575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:56:58.666044 26588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:56:58.670264 26588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:56:58.678259 26588 catalog_manager.cc:1347] Generated new cluster ID: bf6bff7a61674e86894e549cfae3bbe5
I20260809 18:56:58.678350 26588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:56:58.691183 26588 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:56:58.692384 26588 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:56:58.706750 26588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: Generated new TSK 0
I20260809 18:56:58.707512 26588 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab.
Entry for principal oryx/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab.
I20260809 18:56:58.763901 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33951
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab
--principal=oryx/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:59.089975 26605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:59.090346 26605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:59.090497 26605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:59.097769 26605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:59.097867 26605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:59.097990 26605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:56:59.107466 26605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab
--principal=oryx/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:59.108644 26605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:59.109903 26605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:59.122212 26612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:59.122340 26613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:59.122253 26615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:59.123041 26605 server_base.cc:1034] running on GCE node
I20260809 18:56:59.123580 26605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:59.124451 26605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:59.125644 26605 hybrid_clock.cc:648] HybridClock initialized: now 1786301819125590 us; error 37 us; skew 500 ppm
I20260809 18:56:59.125912 26605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:59 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301819, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:59.128769 26605 init.cc:377] Logged in from keytab as oryx/127.16.188.193@KRBTEST.COM (short username oryx)
I20260809 18:56:59.130120 26605 webserver.cc:460] Webserver started at http://127.16.188.193:45357/ using document root <none> and password file <none>
I20260809 18:56:59.130719 26605 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:59.130818 26605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:59.131049 26605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:59.133806 26605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "34bf4f29eab445369fca62c74983c34f"
format_stamp: "Formatted at 2026-08-09 18:56:59 on dist-test-slave-266d"
server_key: "cb36ff878f2706990e63662e7b8ff7af"
server_key_iv: "73bc0c500a0eb415b0d49308150bf0f9"
server_key_version: "encryptionkey@0"
I20260809 18:56:59.134567 26605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "34bf4f29eab445369fca62c74983c34f"
format_stamp: "Formatted at 2026-08-09 18:56:59 on dist-test-slave-266d"
server_key: "cb36ff878f2706990e63662e7b8ff7af"
server_key_iv: "73bc0c500a0eb415b0d49308150bf0f9"
server_key_version: "encryptionkey@0"
I20260809 18:56:59.139417 26605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 18:56:59.142671 26624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:59.144034 26605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 18:56:59.144193 26605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "34bf4f29eab445369fca62c74983c34f"
format_stamp: "Formatted at 2026-08-09 18:56:59 on dist-test-slave-266d"
server_key: "cb36ff878f2706990e63662e7b8ff7af"
server_key_iv: "73bc0c500a0eb415b0d49308150bf0f9"
server_key_version: "encryptionkey@0"
I20260809 18:56:59.144366 26605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:59.163434 26605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:59.167167 26605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:59.167440 26605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:59.168331 26605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:59.169713 26605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:59.169800 26605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:59.169914 26605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:59.169965 26605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:59.200642 26605 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:37189
I20260809 18:56:59.200676 26780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:37189 every 8 connection(s)
I20260809 18:56:59.201901 26605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:56:59.205631 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 26605
I20260809 18:56:59.205861 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:56:59.206607 17139 external_mini_cluster.cc:1428] Setting key e11cd5ada50d2cb324494c0451a5dd85
Aug 09 18:56:59 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301819, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:56:59.221230 26784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:59.204291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:35773 (local address 127.16.188.254:33951)
0809 18:56:59.204756 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:59.204764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:59.205735 (+ 971us) server_negotiation.cc:407] Connection header received
0809 18:56:59.207777 (+ 2042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:59.207783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:59.207867 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:59.207966 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:59.209598 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:59.210285 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:59.211784 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:59.212189 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:59.212311 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:59.215722 (+ 3411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:59.215727 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:59.215730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:59.215761 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:59.218239 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:59.218931 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:59.218935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:59.218937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:59.219054 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:59.219483 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:59.219486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:59.219488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:59.219771 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:59.219905 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:59.220597 (+ 692us) server_negotiation.cc:299] Negotiation successful
0809 18:56:59.220819 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":215,"threads_started":1}
I20260809 18:56:59.222164 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:59.204828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.193:35773)
0809 18:56:59.205567 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:59.205620 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:59.207511 (+ 1891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:59.208213 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:59.208220 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:59.208809 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:59.209408 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:59.209425 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:59.210435 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:59.210439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:59.211641 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:59.211653 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:59.212420 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:59.212428 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:59.212656 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:59.213302 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:59.213329 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:59.215511 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:59.218378 (+ 2867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:59.218387 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:59.218403 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:59.218807 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:59.219178 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:59.219184 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:59.219188 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:59.219370 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:59.219893 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:59.219900 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:59.220219 (+ 319us) client_negotiation.cc:769] Sending connection context
0809 18:56:59.220455 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 18:56:59.220977 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":318,"threads_started":1}
I20260809 18:56:59.223773 26782 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33951
I20260809 18:56:59.224094 26782 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:59.225019 26782 heartbeater.cc:511] Master 127.16.188.254:33951 requested a full tablet report, sending...
I20260809 18:56:59.227545 26506 ts_manager.cc:194] Registered new tserver with Master: 34bf4f29eab445369fca62c74983c34f (127.16.188.193:37189)
I20260809 18:56:59.229604 26506 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:35773
WARNING: no policy specified for oryx/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab.
Entry for principal oryx/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab.
I20260809 18:56:59.259649 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33951
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab
--principal=oryx/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:56:59.582737 26792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:56:59.582985 26792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:56:59.583117 26792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:56:59.590008 26792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:56:59.590103 26792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:56:59.590243 26792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:56:59.599246 26792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab
--principal=oryx/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:56:59.600380 26792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:56:59.601648 26792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:56:59.614243 26806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:59.614334 26801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:56:59.614313 26799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:56:59.615151 26792 server_base.cc:1034] running on GCE node
I20260809 18:56:59.615708 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:56:59.616636 26792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:56:59.617837 26792 hybrid_clock.cc:648] HybridClock initialized: now 1786301819617792 us; error 78 us; skew 500 ppm
I20260809 18:56:59.618129 26792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:56:59 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301819, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:56:59.621165 26792 init.cc:377] Logged in from keytab as oryx/127.16.188.194@KRBTEST.COM (short username oryx)
I20260809 18:56:59.622573 26792 webserver.cc:460] Webserver started at http://127.16.188.194:44125/ using document root <none> and password file <none>
I20260809 18:56:59.623201 26792 fs_manager.cc:359] Metadata directory not provided
I20260809 18:56:59.623317 26792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:56:59.623592 26792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:56:59.626336 26792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "880fce2d9251422f815f9a329a618a61"
format_stamp: "Formatted at 2026-08-09 18:56:59 on dist-test-slave-266d"
server_key: "4188e960df6d8c68b52a548aad360750"
server_key_iv: "454d86e5c70220a719e066ce25c03506"
server_key_version: "encryptionkey@0"
I20260809 18:56:59.627075 26792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "880fce2d9251422f815f9a329a618a61"
format_stamp: "Formatted at 2026-08-09 18:56:59 on dist-test-slave-266d"
server_key: "4188e960df6d8c68b52a548aad360750"
server_key_iv: "454d86e5c70220a719e066ce25c03506"
server_key_version: "encryptionkey@0"
I20260809 18:56:59.631901 26792 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 18:56:59.635139 26816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:59.636360 26792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:56:59.636502 26792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "880fce2d9251422f815f9a329a618a61"
format_stamp: "Formatted at 2026-08-09 18:56:59 on dist-test-slave-266d"
server_key: "4188e960df6d8c68b52a548aad360750"
server_key_iv: "454d86e5c70220a719e066ce25c03506"
server_key_version: "encryptionkey@0"
I20260809 18:56:59.636696 26792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:56:59.675633 26792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:56:59.679514 26792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:56:59.679772 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:56:59.680636 26792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:56:59.681960 26792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:56:59.682040 26792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:59.682135 26792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:56:59.682188 26792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:56:59.712402 26792 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:41977
I20260809 18:56:59.712488 26993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:41977 every 8 connection(s)
I20260809 18:56:59.713701 26792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:56:59.721998 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 26792
I20260809 18:56:59.722188 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:56:59.722697 17139 external_mini_cluster.cc:1428] Setting key 6ba2c34af547a6429f007ea0871c2d7a
Aug 09 18:56:59 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301819, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:56:59.737929 26784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:59.716127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:44717 (local address 127.16.188.254:33951)
0809 18:56:59.716290 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 18:56:59.716295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:56:59.717447 (+ 1152us) server_negotiation.cc:407] Connection header received
0809 18:56:59.719246 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:56:59.719253 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:56:59.719334 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:56:59.719424 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:56:59.720870 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:59.721607 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:59.723573 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:56:59.724260 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:56:59.724381 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:59.731868 (+ 7487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:56:59.731874 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:56:59.731879 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:56:59.731919 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:56:59.734847 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:59.735704 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:59.735707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:59.735710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:59.735829 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:56:59.736290 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:56:59.736292 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:56:59.736294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:56:59.736554 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:56:59.736662 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 18:56:59.737487 (+ 825us) server_negotiation.cc:299] Negotiation successful
0809 18:56:59.737659 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:56:59.739354 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:56:59.716572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.194:44717)
0809 18:56:59.717296 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 18:56:59.717334 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:56:59.718969 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:56:59.719665 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:56:59.719673 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:56:59.720147 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:56:59.720695 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:59.720712 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:59.721761 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:59.721765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:59.723371 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:56:59.723388 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:56:59.724692 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:56:59.724698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:56:59.724985 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:56:59.729291 (+ 4306us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:56:59.729315 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:56:59.731607 (+ 2292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:56:59.735000 (+ 3393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:59.735009 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:59.735027 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:59.735588 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:59.735933 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:56:59.735938 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:56:59.735941 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:56:59.736194 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:56:59.736681 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:56:59.736689 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:56:59.737125 (+ 436us) client_negotiation.cc:769] Sending connection context
0809 18:56:59.737430 (+ 305us) client_negotiation.cc:240] Negotiation successful
0809 18:56:59.737939 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":276,"threads_started":1}
I20260809 18:56:59.740742 26995 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33951
I20260809 18:56:59.741056 26995 heartbeater.cc:464] Registering TS with master...
I20260809 18:56:59.741844 26995 heartbeater.cc:511] Master 127.16.188.254:33951 requested a full tablet report, sending...
I20260809 18:56:59.743294 26506 ts_manager.cc:194] Registered new tserver with Master: 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977)
I20260809 18:56:59.744069 26506 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:44717
WARNING: no policy specified for oryx/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab.
Entry for principal oryx/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab.
I20260809 18:56:59.774111 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33951
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab
--principal=oryx/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:00.093604 27000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:00.093884 27000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:00.094029 27000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:00.100994 27000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:00.101136 27000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:00.101311 27000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:57:00.110994 27000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab
--principal=oryx/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:00.112355 27000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:00.113682 27000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:00.126106 27008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:00.126176 27015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:00.126263 27009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:00.127242 27000 server_base.cc:1034] running on GCE node
I20260809 18:57:00.127785 27000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:00.128651 27000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:00.129848 27000 hybrid_clock.cc:648] HybridClock initialized: now 1786301820129788 us; error 48 us; skew 500 ppm
I20260809 18:57:00.130131 27000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:00 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301820, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:00.133028 27000 init.cc:377] Logged in from keytab as oryx/127.16.188.195@KRBTEST.COM (short username oryx)
I20260809 18:57:00.134428 27000 webserver.cc:460] Webserver started at http://127.16.188.195:42127/ using document root <none> and password file <none>
I20260809 18:57:00.135043 27000 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:00.135154 27000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:00.135449 27000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:00.138252 27000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "4212fc9479d44bc6a7369bd43623e133"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "98b898fa95e57e51593e7289b01177e5"
server_key_iv: "e44721751c6d64f01fe275ed54612d87"
server_key_version: "encryptionkey@0"
I20260809 18:57:00.138970 27000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "4212fc9479d44bc6a7369bd43623e133"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "98b898fa95e57e51593e7289b01177e5"
server_key_iv: "e44721751c6d64f01fe275ed54612d87"
server_key_version: "encryptionkey@0"
I20260809 18:57:00.143784 27000 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 18:57:00.146925 27025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:00.148121 27000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:57:00.148257 27000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "4212fc9479d44bc6a7369bd43623e133"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "98b898fa95e57e51593e7289b01177e5"
server_key_iv: "e44721751c6d64f01fe275ed54612d87"
server_key_version: "encryptionkey@0"
I20260809 18:57:00.148409 27000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:00.161837 27000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:00.165330 27000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:00.165562 27000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:00.166383 27000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:00.167629 27000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:00.167699 27000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:00.167794 27000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:00.167840 27000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:00.196245 27000 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:43579
I20260809 18:57:00.196291 27198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:43579 every 8 connection(s)
I20260809 18:57:00.197510 27000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:00.202976 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 27000
I20260809 18:57:00.203191 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:00.203776 17139 external_mini_cluster.cc:1428] Setting key b292b2d0bfcf547b731458a39a3b5dcf
Aug 09 18:57:00 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301820, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:00.216778 26784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.199987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:60735 (local address 127.16.188.254:33951)
0809 18:57:00.200158 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.200162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.201493 (+ 1331us) server_negotiation.cc:407] Connection header received
0809 18:57:00.203243 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.203249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.203359 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.203456 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:00.205140 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.206106 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.207755 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.208160 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.208273 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.211442 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:00.211447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:00.211450 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:00.211481 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:00.213892 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.214553 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.214557 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.214560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.214695 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.215099 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.215103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.215105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.215412 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:00.215544 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.216181 (+ 637us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.216410 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:57:00.217705 27202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.200550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.195:60735)
0809 18:57:00.201341 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.201378 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:00.202977 (+ 1599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:00.203702 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:00.203712 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:00.204260 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:00.204948 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.204974 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.206258 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.206262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.207616 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.207629 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.208378 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.208386 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.208605 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.209231 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:00.209253 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:00.211251 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:00.214036 (+ 2785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.214045 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.214057 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.214440 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.214801 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.214805 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.214809 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.214992 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.215537 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:00.215544 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:00.215842 (+ 298us) client_negotiation.cc:769] Sending connection context
0809 18:57:00.216066 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 18:57:00.216568 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":316,"threads_started":1}
I20260809 18:57:00.218950 27200 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33951
I20260809 18:57:00.219208 27200 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:00.219856 27200 heartbeater.cc:511] Master 127.16.188.254:33951 requested a full tablet report, sending...
I20260809 18:57:00.221208 26506 ts_manager.cc:194] Registered new tserver with Master: 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579)
I20260809 18:57:00.221987 26506 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:60735
I20260809 18:57:00.230930 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:57:00.232638 26782 heartbeater.cc:503] Master 127.16.188.254:33951 was elected leader, sending a full tablet report...
WARNING: no policy specified for oryx/127.16.188.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.253.keytab.
Entry for principal oryx/127.16.188.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.253.keytab.
I20260809 18:57:00.280692 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.253:45709
--webserver_interface=127.16.188.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.253.keytab
--principal=oryx/127.16.188.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:33951,127.16.188.253:45709
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:00.603236 27206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:00.603502 27206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:00.603634 27206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:00.610898 27206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:00.610996 27206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:00.611073 27206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:00.611143 27206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:00.611205 27206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:00.620565 27206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:33951,127.16.188.253:45709
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.253.keytab
--principal=oryx/127.16.188.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.253:45709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.188.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
W20260809 18:57:00.620895 27206 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.16.188.254:33951,127.16.188.253:45709'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 18:57:00.622079 27206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:00.623345 27206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:00.634622 27213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:00.634532 27216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:00.634572 27214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:00.635381 27206 server_base.cc:1034] running on GCE node
I20260809 18:57:00.636039 27206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:00.637395 27206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:00.638679 27206 hybrid_clock.cc:648] HybridClock initialized: now 1786301820638599 us; error 47 us; skew 500 ppm
I20260809 18:57:00.639016 27206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:00 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301820, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:00.644454 27206 init.cc:377] Logged in from keytab as oryx/127.16.188.253@KRBTEST.COM (short username oryx)
I20260809 18:57:00.645828 27206 webserver.cc:460] Webserver started at http://127.16.188.253:46707/ using document root <none> and password file <none>
I20260809 18:57:00.646499 27206 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:00.646595 27206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:00.646875 27206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:00.649991 27206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data/instance:
uuid: "7dffe902135142a1bed30839a14379b0"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "38518b3aa74b77aebc117462b3ca2d73"
server_key_iv: "e1ed562f3421cb2c8002b66693282993"
server_key_version: "encryptionkey@0"
I20260809 18:57:00.650728 27206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal/instance:
uuid: "7dffe902135142a1bed30839a14379b0"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "38518b3aa74b77aebc117462b3ca2d73"
server_key_iv: "e1ed562f3421cb2c8002b66693282993"
server_key_version: "encryptionkey@0"
I20260809 18:57:00.655699 27206 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 18:57:00.659111 27231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:00.660450 27206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:57:00.660610 27206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
uuid: "7dffe902135142a1bed30839a14379b0"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "38518b3aa74b77aebc117462b3ca2d73"
server_key_iv: "e1ed562f3421cb2c8002b66693282993"
server_key_version: "encryptionkey@0"
I20260809 18:57:00.660804 27206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:00.681854 27206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:00.685577 27206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:00.685814 27206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:00.702430 27206 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.253:45709
I20260809 18:57:00.702474 27311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.253:45709 every 8 connection(s)
I20260809 18:57:00.703660 27206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
I20260809 18:57:00.707432 27312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:00.710198 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 27206
I20260809 18:57:00.715540 27312 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:57:00 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301820, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.253@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
Aug 09 18:57:00 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.253@KRBTEST.COM
I20260809 18:57:00.736948 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.718532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35616 (local address 127.16.188.254:33951)
0809 18:57:00.720513 (+ 1981us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.720518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.721072 (+ 554us) server_negotiation.cc:407] Connection header received
0809 18:57:00.722179 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.722184 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.722256 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.722385 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:00.723654 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.724416 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.726134 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.726838 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.726954 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.730875 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:00.730880 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:00.730883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:00.730918 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:00.733643 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.734470 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.734474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.734477 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.734608 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.735061 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.735065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.735068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.735482 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:00.735620 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.736452 (+ 832us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.736608 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1861,"thread_start_us":1761,"threads_started":1}
I20260809 18:57:00.738198 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.718579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:35616)
0809 18:57:00.720929 (+ 2350us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.720964 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:00.721877 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:00.722481 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:00.722488 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:00.723143 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:00.723486 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.723502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.724562 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.724567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.725975 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.725986 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.727237 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.727244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.727431 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.728118 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:00.728156 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:00.730689 (+ 2533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:00.733759 (+ 3070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.733778 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.733790 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.734358 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.734721 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.734726 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.734729 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.734958 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.735608 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:00.735615 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:00.736007 (+ 392us) client_negotiation.cc:769] Sending connection context
0809 18:57:00.736355 (+ 348us) client_negotiation.cc:240] Negotiation successful
0809 18:57:00.736846 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2155,"mutex_wait_us":1,"spinlock_wait_cycles":19328,"thread_start_us":2018,"threads_started":1}
I20260809 18:57:00.738216 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.712585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53558 (local address 127.16.188.253:45709)
0809 18:57:00.719690 (+ 7105us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.719704 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.719753 (+ 49us) server_negotiation.cc:407] Connection header received
0809 18:57:00.721860 (+ 2107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.721881 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.722113 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.722307 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:00.723707 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.724994 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.726352 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.727115 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.727323 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.731899 (+ 4576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:00.731906 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:00.731918 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:00.731950 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:00.734876 (+ 2926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.735609 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.735616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.735619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.735767 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.736118 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.736127 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.736130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.736568 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:00.736853 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.737226 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.737478 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":6873,"thread_start_us":6646,"threads_started":1}
I20260809 18:57:00.740289 27312 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:57:00 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301820, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.253@KRBTEST.COM for oryx/127.16.188.253@KRBTEST.COM
I20260809 18:57:00.746526 26995 heartbeater.cc:503] Master 127.16.188.254:33951 was elected leader, sending a full tablet report...
I20260809 18:57:00.751793 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.741136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.0.0.1:53570)
0809 18:57:00.741291 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.741310 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:00.741392 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:00.741714 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:00.741718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:00.742013 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:00.742186 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.742195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.743057 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.743061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.743889 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.743899 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.744488 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.744492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.744615 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.745070 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:00.745114 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:00.747028 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:00.749766 (+ 2738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.749770 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.749772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.750126 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.750413 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.750415 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.750418 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.750537 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.751041 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:00.751044 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:00.751150 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 18:57:00.751247 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 18:57:00.751499 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 18:57:00.751838 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.741135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53570 (local address 127.16.188.253:45709)
0809 18:57:00.741523 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.741526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.741536 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:57:00.741561 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.741564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.741605 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.741669 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:00.742304 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.742944 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.743994 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.744376 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.744472 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.747188 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:00.747195 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:00.747199 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:00.747233 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:00.749655 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.750215 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.750218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.750221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.750330 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.750654 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.750658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.750660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.750942 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:00.751058 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.751340 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.751612 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":309}
I20260809 18:57:00.756469 27312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Bootstrap starting.
I20260809 18:57:00.761231 27312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:00.762504 27312 log.cc:824] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:00.766616 27312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: No bootstrap required, opened a new log
I20260809 18:57:00.774538 27312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } }
I20260809 18:57:00.774819 27312 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:00.774917 27312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dffe902135142a1bed30839a14379b0, State: Initialized, Role: FOLLOWER
I20260809 18:57:00.775454 27312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } }
I20260809 18:57:00.776412 27320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } } }
I20260809 18:57:00.776805 27320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:57:00.777498 27312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 18:57:00.788698 27343 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:57:00.788825 27343 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:57:00.790648 27206 master_runner.cc:428] Detected that this master 7dffe902135142a1bed30839a14379b0 is joining an existing cluster
I20260809 18:57:00.790782 27206 master_runner.cc:432] Initiating AddMaster RPC to add 127.16.188.253:45709
WARNING: no policy specified for oryx/127.16.188.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.252@KRBTEST.COM" created.
I20260809 18:57:00.871141 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.828925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35626 (local address 127.16.188.254:33951)
0809 18:57:00.829149 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.829155 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.841033 (+ 11878us) server_negotiation.cc:407] Connection header received
0809 18:57:00.841304 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.841311 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.841449 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.841562 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:00.847952 (+ 6390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.849740 (+ 1788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.860725 (+ 10985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.861464 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.861614 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.864282 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:00.864289 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:00.864294 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:00.864354 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:00.867794 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.868790 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.868795 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.868799 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.868949 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.869436 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.869441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.869445 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.869796 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:00.869934 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.870557 (+ 623us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.870800 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 18:57:00.872229 27354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.829496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:35626)
0809 18:57:00.840891 (+ 11395us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.840914 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:00.841141 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:00.841761 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:00.841766 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:00.847246 (+ 5480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:00.847715 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.847733 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.854977 (+ 7244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.854980 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.860501 (+ 5521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.860516 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.861907 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.861916 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.862149 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.862802 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:00.862830 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:00.864009 (+ 1179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:00.868069 (+ 4060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.868074 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.868078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.868539 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.869122 (+ 583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.869127 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.869130 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.869307 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.870027 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:00.870032 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:00.870231 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 18:57:00.871420 (+ 1189us) client_negotiation.cc:240] Negotiation successful
0809 18:57:00.871708 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11189,"mutex_wait_us":3610,"thread_start_us":13114,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.252.keytab.
Entry for principal oryx/127.16.188.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.252.keytab.
I20260809 18:57:00.877296 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.252:41941
--webserver_interface=127.16.188.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.252.keytab
--principal=oryx/127.16.188.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:33951,127.16.188.253:45709,127.16.188.252:41941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:57:00.906937 27356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.829838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.0.0.1:53574)
0809 18:57:00.852822 (+ 22984us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.852843 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:00.852978 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:00.854916 (+ 1938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:00.854920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:00.856152 (+ 1232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:00.856533 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.856546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.858036 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.858042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.859653 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.859672 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.860973 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.860980 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.861157 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.862076 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:00.862100 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:00.895119 (+ 33019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:00.901383 (+ 6264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.901389 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.901393 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.901965 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.903789 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.903794 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.903798 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.903970 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.905584 (+ 1614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:00.905590 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:00.905806 (+ 216us) client_negotiation.cc:769] Sending connection context
0809 18:57:00.905981 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 18:57:00.906324 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18381,"mutex_wait_us":50,"thread_start_us":10621,"threads_started":1}
I20260809 18:57:00.908408 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.829689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53574 (local address 127.16.188.253:45709)
0809 18:57:00.829858 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.829864 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.852937 (+ 23073us) server_negotiation.cc:407] Connection header received
0809 18:57:00.853127 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.853132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.853209 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.853302 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:00.856672 (+ 3370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.857792 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.859795 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.860538 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.860671 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.897115 (+ 36444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:00.897124 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:00.897128 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:00.897172 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:00.901204 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.902130 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.902135 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.902139 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.902331 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.904112 (+ 1781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.904122 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.904126 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.904574 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:00.904738 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.907706 (+ 2968us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.907954 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":64}
Aug 09 18:57:00 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.254@KRBTEST.COM for oryx/127.16.188.253@KRBTEST.COM
W20260809 18:57:00.937794 27239 tablet.cc:2369] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:57:00.942655 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.884584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53580 (local address 127.16.188.253:45709)
0809 18:57:00.910608 (+ 26024us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:00.910615 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:00.922650 (+ 12035us) server_negotiation.cc:407] Connection header received
0809 18:57:00.923130 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:00.923136 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:00.923267 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:00.923353 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:00.925826 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.926977 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.929009 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.929810 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.929916 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.934552 (+ 4636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:00.934574 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:00.934579 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:00.934622 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:00.938594 (+ 3972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.939667 (+ 1073us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.939673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.939677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.939862 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:00.940425 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:00.940431 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:00.940434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:00.940920 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:00.941161 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:00.941935 (+ 774us) server_negotiation.cc:299] Negotiation successful
0809 18:57:00.942195 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25899,"thread_start_us":37263,"threads_started":1}
I20260809 18:57:00.943813 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:00.884187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.0.0.1:53580)
0809 18:57:00.922483 (+ 38296us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:00.922536 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:00.922835 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:00.923707 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:00.923715 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:00.924605 (+ 890us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:00.924963 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.924978 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.927196 (+ 2218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.927202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.928823 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:00.928842 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:00.930223 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:00.930230 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:00.930437 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:00.931254 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:00.931284 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:00.934311 (+ 3027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:00.938793 (+ 4482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.938806 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.938813 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.939483 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.940073 (+ 590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:00.940078 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:00.940082 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:00.940270 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:00.941305 (+ 1035us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:00.941314 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:00.941539 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 18:57:00.942978 (+ 1439us) client_negotiation.cc:240] Negotiation successful
0809 18:57:00.943339 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38020,"thread_start_us":40951,"threads_started":1}
I20260809 18:57:00.946115 26505 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.16.188.253:45709: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7dffe902135142a1bed30839a14379b0"
member_type: NON_VOTER
last_known_addr {
host: "127.16.188.253"
port: 45709
}
attrs {
promote: true
}
}
dest_uuid: "468a04419f064f3b8a267c0cd9990914"
cas_config_opid_index: -1
I20260809 18:57:00.947781 26505 consensus_queue.cc:237] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } }
I20260809 18:57:00.965231 27273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:00.964771 27364 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7dffe902135142a1bed30839a14379b0 (127.16.188.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:00.968685 27273 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Refusing update from remote peer 468a04419f064f3b8a267c0cd9990914: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 18:57:00.977526 27363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:00.979993 27364 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.16.188.253:45709
I20260809 18:57:00.980507 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:00.980727 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:00.982024 27206 master.cc:537] Master@127.16.188.253:45709 shutting down...
I20260809 18:57:01.029882 27273 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7dffe902135142a1bed30839a14379b0 (127.16.188.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:01.041585 27320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 468a04419f064f3b8a267c0cd9990914. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:01.041888 27320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:57:01.042294 27369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:01.042604 27369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:57:01.043740 27372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:01.044147 27372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:57:01.046132 27206 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 LEARNER]: Raft consensus shutting down.
I20260809 18:57:01.046619 27206 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 LEARNER]: Raft consensus is shut down!
I20260809 18:57:01.046780 27206 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: stopping tablet replica
I20260809 18:57:01.130210 27206 master.cc:552] Master@127.16.188.253:45709 shutdown complete.
I20260809 18:57:01.130342 27206 master_runner.cc:305] Clearing existing system tablet
I20260809 18:57:01.130744 27206 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:01.130834 27206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:01.133261 27206 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 18:57:01.137497 27376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:01.137904 27206 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:01.138216 27206 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260809 18:57:01.138326 27206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
uuid: "7dffe902135142a1bed30839a14379b0"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "38518b3aa74b77aebc117462b3ca2d73"
server_key_iv: "e1ed562f3421cb2c8002b66693282993"
server_key_version: "encryptionkey@0"
I20260809 18:57:01.143841 27206 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:01.151309 27206 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 18:57:01.151518 27206 log.cc:1196] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 18:57:01.152202 27206 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Deleting consensus metadata
I20260809 18:57:01.152575 27206 master_runner.cc:315] Copying system tablet from 127.16.188.254:33951
I20260809 18:57:01.156111 27206 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.254:33951
I20260809 18:57:01.174253 27384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.157420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:35634)
0809 18:57:01.158239 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.158263 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.158594 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.159134 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.159140 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.159828 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.160212 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.160231 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.161916 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.161922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.163475 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.163492 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.164605 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.164612 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.164795 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.165567 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.165594 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.166668 (+ 1074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.170957 (+ 4289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.170962 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.170966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.171457 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.172088 (+ 631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.172097 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.172100 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.172284 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.173019 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.173025 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.173249 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.173413 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.173746 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":450,"threads_started":1}
I20260809 18:57:01.174269 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.157484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35634 (local address 127.16.188.254:33951)
0809 18:57:01.157728 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.157735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.158423 (+ 688us) server_negotiation.cc:407] Connection header received
0809 18:57:01.158839 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.158847 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.158945 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.159057 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.160500 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.161715 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.163665 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.164401 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.164566 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.166895 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.166903 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.166909 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.166956 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.170810 (+ 3854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.171606 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.171613 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.171617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.171812 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.172406 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.172412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.172416 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.172857 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.173036 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.173550 (+ 514us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.173816 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 18:57:01.175851 26538 tablet_copy_service.cc:140] P 468a04419f064f3b8a267c0cd9990914: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7dffe902135142a1bed30839a14379b0 ({username='oryx', principal='oryx/127.16.188.253@KRBTEST.COM'} at 127.0.0.1:35634)
I20260809 18:57:01.176446 26538 tablet_copy_service.cc:161] P 468a04419f064f3b8a267c0cd9990914: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7dffe902135142a1bed30839a14379b0 at {username='oryx', principal='oryx/127.16.188.253@KRBTEST.COM'} at 127.0.0.1:35634: session id = 7dffe902135142a1bed30839a14379b0-00000000000000000000000000000000
I20260809 18:57:01.181900 26538 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 18:57:01.185042 27206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 18:57:01.194548 27206 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: tablet copy: Starting download of 0 data blocks...
I20260809 18:57:01.195119 27206 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: tablet copy: Starting download of 1 WAL segments...
I20260809 18:57:01.199100 27206 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 18:57:01.204012 26538 tablet_copy_service.cc:342] P 468a04419f064f3b8a267c0cd9990914: Request end of tablet copy session 7dffe902135142a1bed30839a14379b0-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.16.188.253@KRBTEST.COM'} at 127.0.0.1:35634
I20260809 18:57:01.204555 26538 tablet_copy_service.cc:433] P 468a04419f064f3b8a267c0cd9990914: ending tablet copy session 7dffe902135142a1bed30839a14379b0-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7dffe902135142a1bed30839a14379b0
I20260809 18:57:01.218101 27206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:01.220887 27385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:01.224283 27200 heartbeater.cc:503] Master 127.16.188.254:33951 was elected leader, sending a full tablet report...
I20260809 18:57:01.233516 27206 server_base.cc:1034] running on GCE node
W20260809 18:57:01.234826 27386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:01.237442 27389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:01.238018 27206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:01.238767 27206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:01.240120 27206 hybrid_clock.cc:648] HybridClock initialized: now 1786301821239958 us; error 36 us; skew 500 ppm
I20260809 18:57:01.240556 27206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301821, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:01.243768 27206 init.cc:377] Logged in from keytab as oryx/127.16.188.253@KRBTEST.COM (short username oryx)
I20260809 18:57:01.246768 27206 webserver.cc:460] Webserver started at http://127.16.188.253:36605/ using document root <none> and password file <none>
I20260809 18:57:01.247403 27206 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:01.247591 27206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:01.252452 27206 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 18:57:01.256139 27397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:01.256754 27206 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 18:57:01.257042 27206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
uuid: "7dffe902135142a1bed30839a14379b0"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "38518b3aa74b77aebc117462b3ca2d73"
server_key_iv: "e1ed562f3421cb2c8002b66693282993"
server_key_version: "encryptionkey@0"
I20260809 18:57:01.257418 27206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:01.282721 27206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:01.289203 27206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:01.354542 27206 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.253:45709
I20260809 18:57:01.354589 27478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.253:45709 every 8 connection(s)
I20260809 18:57:01.356114 27206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
I20260809 18:57:01.364853 27479 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:57:01.370127 27479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Bootstrap starting.
I20260809 18:57:01.386590 27479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:57:01.387269 27479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: Bootstrap complete.
I20260809 18:57:01.388597 27479 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } }
I20260809 18:57:01.388974 27479 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7dffe902135142a1bed30839a14379b0, State: Initialized, Role: LEARNER
I20260809 18:57:01.389312 27479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } }
I20260809 18:57:01.390966 27487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:01.391534 27487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:57:01.391582 27479 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:01.405777 27510 catalog_manager.cc:1259] Loaded cluster ID: bf6bff7a61674e86894e549cfae3bbe5
I20260809 18:57:01.405866 27510 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: loading cluster ID for follower catalog manager: success
I20260809 18:57:01.409607 27510 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: acquiring CA information for follower catalog manager: success
I20260809 18:57:01.412985 27510 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 18:57:01.486644 27361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:01.487155 27361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:01.487339 27361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:01.501266 27361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:01.501499 27361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:01.501663 27361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:01.501884 27361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:01.502032 27361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:01.515308 27361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:33951,127.16.188.253:45709,127.16.188.252:41941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.252.keytab
--principal=oryx/127.16.188.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.252:41941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.188.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:01.516950 27361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:01.518642 27361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:01.533744 27516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:01.534242 27517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:01.535445 27519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:01.536098 27361 server_base.cc:1034] running on GCE node
I20260809 18:57:01.536866 27361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:01.538244 27361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:01.539443 27361 hybrid_clock.cc:648] HybridClock initialized: now 1786301821539387 us; error 51 us; skew 500 ppm
I20260809 18:57:01.539795 27361 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301821, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:01.544718 27361 init.cc:377] Logged in from keytab as oryx/127.16.188.252@KRBTEST.COM (short username oryx)
I20260809 18:57:01.545282 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:01.545789 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:01.549209 27361 webserver.cc:460] Webserver started at http://127.16.188.252:43599/ using document root <none> and password file <none>
I20260809 18:57:01.550361 27361 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:01.550561 27361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:01.551023 27361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:01.556675 27361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data/instance:
uuid: "72dc4841ff3c4eaa93623a6557647d38"
format_stamp: "Formatted at 2026-08-09 18:57:01 on dist-test-slave-266d"
server_key: "deeb32a24e208928b0ec89cc45d24929"
server_key_iv: "7c6997ef1627adb02e733bb6f9d1bf5e"
server_key_version: "encryptionkey@0"
I20260809 18:57:01.557796 27361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal/instance:
uuid: "72dc4841ff3c4eaa93623a6557647d38"
format_stamp: "Formatted at 2026-08-09 18:57:01 on dist-test-slave-266d"
server_key: "deeb32a24e208928b0ec89cc45d24929"
server_key_iv: "7c6997ef1627adb02e733bb6f9d1bf5e"
server_key_version: "encryptionkey@0"
I20260809 18:57:01.558405 27523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.544594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.0.0.1:53582)
0809 18:57:01.551553 (+ 6959us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.551573 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.551746 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.552136 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.552142 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.552171 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:01.552577 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.552588 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.554288 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.554292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.555925 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.555938 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.557310 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.557318 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.557663 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.557712 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.557796 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.557934 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6838,"thread_start_us":1072,"threads_started":1}
I20260809 18:57:01.558483 27526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.544723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53582 (local address 127.16.188.253:45709)
0809 18:57:01.547202 (+ 2479us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.547209 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.551661 (+ 4452us) server_negotiation.cc:407] Connection header received
0809 18:57:01.551892 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.551896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.551969 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.552078 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:01.552766 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.554103 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.556071 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.557117 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.557381 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.557620 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.557885 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.558018 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2269,"thread_start_us":2083,"threads_started":1}
I20260809 18:57:01.559779 27487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 468a04419f064f3b8a267c0cd9990914. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: NON_VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: true } } }
I20260809 18:57:01.560093 27487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:57:01.561244 27520 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: attempting to promote NON_VOTER 7dffe902135142a1bed30839a14379b0 to VOTER
I20260809 18:57:01.562534 27520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } }
I20260809 18:57:01.564994 27436 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 LEARNER]: Refusing update from remote peer 468a04419f064f3b8a267c0cd9990914: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 18:57:01.565568 27361 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260809 18:57:01.565657 27363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 18:57:01.569362 27520 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7dffe902135142a1bed30839a14379b0 (127.16.188.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } }
I20260809 18:57:01.570348 27436 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7dffe902135142a1bed30839a14379b0 (127.16.188.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } }
I20260809 18:57:01.570899 27533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:01.572774 27361 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260809 18:57:01.572997 27361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
uuid: "72dc4841ff3c4eaa93623a6557647d38"
format_stamp: "Formatted at 2026-08-09 18:57:01 on dist-test-slave-266d"
server_key: "deeb32a24e208928b0ec89cc45d24929"
server_key_iv: "7c6997ef1627adb02e733bb6f9d1bf5e"
server_key_version: "encryptionkey@0"
I20260809 18:57:01.573302 27361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:01.573637 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } }
I20260809 18:57:01.573882 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:01.574103 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } }
I20260809 18:57:01.574532 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:01.575661 27487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } }
I20260809 18:57:01.575984 27487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:57:01.599080 27361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:01.604547 27361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:01.604987 27361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:01.653972 27361 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.252:41941
I20260809 18:57:01.654093 27615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.252:41941 every 8 connection(s)
I20260809 18:57:01.655598 27361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
I20260809 18:57:01.659245 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 27361
I20260809 18:57:01.660354 27616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:01.670293 27616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.252@KRBTEST.COM
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301821, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.252@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:01.685511 27620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.661543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47732 (local address 127.16.188.252:41941)
0809 18:57:01.662827 (+ 1284us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.662839 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.662906 (+ 67us) server_negotiation.cc:407] Connection header received
0809 18:57:01.664727 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.664749 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.665155 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.665540 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.667207 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.668820 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.670216 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.671054 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.671241 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.676920 (+ 5679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.676931 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.676944 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.677000 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.680978 (+ 3978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.681770 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.681777 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.681783 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.682046 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.682535 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.682538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.682540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.683216 (+ 676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.683590 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.683964 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.684378 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":962,"thread_start_us":606,"threads_started":1}
I20260809 18:57:01.691463 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.672898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35648 (local address 127.16.188.254:33951)
0809 18:57:01.673041 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.673045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.674282 (+ 1237us) server_negotiation.cc:407] Connection header received
0809 18:57:01.674469 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.674474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.674537 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.674619 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.676364 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.677633 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.679446 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.680274 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.680416 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.684917 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.684922 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.684925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.684962 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.688808 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.689753 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.689757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.689759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.689904 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.690292 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.690295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.690297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.690556 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.690685 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.691097 (+ 412us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.691246 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:57:01.691694 27622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.673174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:35648)
0809 18:57:01.674139 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.674171 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.674333 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.674711 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.674717 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.675658 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.676201 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.676216 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.677784 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.677790 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.679324 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.679337 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.680523 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.680529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.680711 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.681441 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.681467 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.684706 (+ 3239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.688921 (+ 4215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.688928 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.688933 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.689547 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.690004 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.690007 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.690009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.690200 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.690657 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.690662 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.690814 (+ 152us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.691022 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.691244 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"thread_start_us":645,"threads_started":1}
I20260809 18:57:01.693313 27616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301821, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.252@KRBTEST.COM for oryx/127.16.188.253@KRBTEST.COM
I20260809 18:57:01.706699 27622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.694083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.0.0.1:53586)
0809 18:57:01.694245 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.694260 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.694342 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.694564 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.694566 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.694902 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.695027 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.695035 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.695943 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.695946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.697193 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.697206 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.698061 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.698066 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.698210 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.698757 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.698772 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.701146 (+ 2374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.704519 (+ 3373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.704522 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.704524 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.704988 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.705365 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.705368 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.705370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.705531 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.706067 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.706070 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.706180 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.706280 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.706457 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 18:57:01.706970 27526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.693964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53586 (local address 127.16.188.253:45709)
0809 18:57:01.694162 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.694168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.694322 (+ 154us) server_negotiation.cc:407] Connection header received
0809 18:57:01.694418 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.694422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.694483 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.694555 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.695127 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.695837 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.697323 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.697936 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.698053 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.701332 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.701337 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.701340 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.701370 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.704417 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.705080 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.705084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.705102 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.705279 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.705607 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.705610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.705612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.705967 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.706075 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.706404 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.706632 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 18:57:01.707957 27616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301821, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.252@KRBTEST.COM for oryx/127.16.188.252@KRBTEST.COM
I20260809 18:57:01.719748 27622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.708668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41941 (local address 127.0.0.1:47748)
0809 18:57:01.708892 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.708906 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.708991 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.709248 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.709251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.709680 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.709839 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.709847 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.711009 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.711013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.711830 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.711841 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.712722 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.712727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.712871 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.713382 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.713397 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.715128 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.717643 (+ 2515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.717648 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.717652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.717967 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.718298 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.718303 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.718307 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.718439 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.718878 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.718882 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.719024 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.719134 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.719352 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 18:57:01.719830 27620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.708579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47748 (local address 127.16.188.252:41941)
0809 18:57:01.708723 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.708727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.708967 (+ 240us) server_negotiation.cc:407] Connection header received
0809 18:57:01.709062 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.709065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.709148 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.709212 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.709948 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.710908 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.711956 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.712556 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.712663 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.715289 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.715294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.715297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.715323 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.717523 (+ 2200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.718066 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.718071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.718074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.718195 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.718533 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.718537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.718541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.718775 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.718891 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.719233 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.719507 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":57}
I20260809 18:57:01.725032 27616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Bootstrap starting.
I20260809 18:57:01.728860 27616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:01.730485 27616 log.cc:824] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:01.733382 27616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: No bootstrap required, opened a new log
I20260809 18:57:01.742995 27616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } }
I20260809 18:57:01.743297 27616 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:01.743381 27616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72dc4841ff3c4eaa93623a6557647d38, State: Initialized, Role: FOLLOWER
I20260809 18:57:01.743901 27616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } }
I20260809 18:57:01.745164 27624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } } }
I20260809 18:57:01.745613 27624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:57:01.745906 27616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 18:57:01.756935 27636 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:57:01.757079 27636 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:57:01.760998 27361 master_runner.cc:428] Detected that this master 72dc4841ff3c4eaa93623a6557647d38 is joining an existing cluster
I20260809 18:57:01.761117 27361 master_runner.cc:432] Initiating AddMaster RPC to add 127.16.188.252:41941
I20260809 18:57:01.769066 27624 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:01.769398 27624 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } }
I20260809 18:57:01.771157 27624 leader_election.cc:288] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 468a04419f064f3b8a267c0cd9990914 (127.16.188.254:33951), 7dffe902135142a1bed30839a14379b0 (127.16.188.253:45709)
I20260809 18:57:01.771708 27436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "72dc4841ff3c4eaa93623a6557647d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dffe902135142a1bed30839a14379b0" is_pre_election: true
I20260809 18:57:01.772802 26520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "72dc4841ff3c4eaa93623a6557647d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "468a04419f064f3b8a267c0cd9990914" is_pre_election: true
I20260809 18:57:01.774685 27540 leader_election.cc:302] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72dc4841ff3c4eaa93623a6557647d38; no voters: 468a04419f064f3b8a267c0cd9990914, 7dffe902135142a1bed30839a14379b0
I20260809 18:57:01.775260 27624 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 18:57:01.790424 27620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.766295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47750 (local address 127.16.188.252:41941)
0809 18:57:01.766579 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.766584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.767321 (+ 737us) server_negotiation.cc:407] Connection header received
0809 18:57:01.767548 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.767554 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.767620 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.767682 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.769462 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.770924 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.773879 (+ 2955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.776299 (+ 2420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.776448 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.780012 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.780023 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.780029 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.780076 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.786823 (+ 6747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.787723 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.787728 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.787731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.788007 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.788554 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.788559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.788561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.789033 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.789223 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.789822 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.790039 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 18:57:01.791392 27643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.766253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41941 (local address 127.0.0.1:47750)
0809 18:57:01.767186 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.767237 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.767421 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.767892 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.767896 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.768861 (+ 965us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.769300 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.769314 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.771219 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.771225 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.773706 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.773723 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.776625 (+ 2902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.776634 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.776798 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.777615 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.777638 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.779700 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.786966 (+ 7266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.786971 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.786975 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.787614 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.788155 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.788159 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.788162 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.788433 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.789319 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.789328 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.789560 (+ 232us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.790638 (+ 1078us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.790961 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"thread_start_us":615,"threads_started":1}
I20260809 18:57:01.792335 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 26605
I20260809 18:57:01.798009 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.765894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35654 (local address 127.16.188.254:33951)
0809 18:57:01.766095 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.766101 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.776620 (+ 10519us) server_negotiation.cc:407] Connection header received
0809 18:57:01.776914 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.776921 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.777001 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.777076 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.781296 (+ 4220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.782638 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.785398 (+ 2760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.786289 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.786391 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.789323 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.789330 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.789335 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.789375 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.794175 (+ 4800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.795346 (+ 1171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.795352 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.795356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.795527 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.796050 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.796056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.796059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.796575 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.796724 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.797430 (+ 706us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.797669 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 18:57:01.799242 27644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.766290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:35654)
0809 18:57:01.776519 (+ 10229us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.776538 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.776743 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.777638 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.777642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.779711 (+ 2069us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.781147 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.781162 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.782824 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.782830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.785211 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.785230 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.786892 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.786900 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.787224 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.787896 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.787923 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.789109 (+ 1186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.794694 (+ 5585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.794699 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.794703 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.795202 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.795729 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.795733 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.795737 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.795906 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.796818 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.796824 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.797043 (+ 219us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.798447 (+ 1404us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.798768 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9979,"thread_start_us":13646,"threads_started":1}
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.193@KRBTEST.COM
I20260809 18:57:01.812285 27526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.765917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53594 (local address 127.16.188.253:45709)
0809 18:57:01.766096 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.766101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.781046 (+ 14945us) server_negotiation.cc:407] Connection header received
0809 18:57:01.781636 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.781642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.781763 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.781870 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.783904 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.785342 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.788578 (+ 3236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.789414 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.789513 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.797243 (+ 7730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.797251 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.797256 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.797301 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.801063 (+ 3762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.802099 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.802105 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.802109 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.802615 (+ 506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.803522 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.803527 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.803531 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.809011 (+ 5480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.809219 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.811478 (+ 2259us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.811772 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 18:57:01.813828 27647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.766963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.0.0.1:53594)
0809 18:57:01.780936 (+ 13973us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.780959 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.781470 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.781915 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.781920 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.782933 (+ 1013us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.783713 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.783729 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.785551 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.785556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.788433 (+ 2877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.788444 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.789876 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.789883 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.794364 (+ 4481us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.795113 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.795135 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.796889 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.801306 (+ 4417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.801312 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.801315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.801920 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.802807 (+ 887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.802812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.802815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.803350 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.810579 (+ 7229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.810585 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.811007 (+ 422us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.812755 (+ 1748us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.813197 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13705,"thread_start_us":8869,"threads_started":1}
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.254@KRBTEST.COM for oryx/127.16.188.252@KRBTEST.COM
I20260809 18:57:01.821408 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.793577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38292 (local address 127.16.188.193:37189)
0809 18:57:01.794698 (+ 1121us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.794707 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.794736 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:57:01.794842 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.794853 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.795131 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.797362 (+ 2231us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.797718 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.799274 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.801457 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.802735 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.803669 (+ 934us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.810754 (+ 7085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.810773 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.810793 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.810839 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.817983 (+ 7144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.818883 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.818894 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.818898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.819126 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.819629 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.819635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.819637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.819994 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.820301 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.820766 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.820970 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":916,"thread_start_us":829,"threads_started":1}
I20260809 18:57:01.822866 26773 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:01.826884 27523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.805053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41941 (local address 127.0.0.1:47752)
0809 18:57:01.805424 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.805444 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.805578 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.806475 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.806481 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.807212 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.807567 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.807583 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.809365 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.809371 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.810856 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.810872 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.812620 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.812628 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.812902 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.813795 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.813826 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.817291 (+ 3465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.823696 (+ 6405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.823700 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.823704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.824393 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.824902 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.824907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.824911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.825112 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.825797 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.825802 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.825975 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.826213 (+ 238us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.826499 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238}
I20260809 18:57:01.828007 27620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.805210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47752 (local address 127.16.188.252:41941)
0809 18:57:01.805807 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.805824 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.805843 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:57:01.805941 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.805947 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.806100 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.806205 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.807799 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.809246 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.811116 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.812199 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.812328 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.817505 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.817512 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.817517 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.817553 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.823514 (+ 5961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.824551 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.824556 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.824559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.824763 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.825256 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.825261 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.825264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.825597 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.825733 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.827292 (+ 1559us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.827536 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475}
I20260809 18:57:01.829380 26505 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.16.188.252:41941: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38"
member_type: NON_VOTER
last_known_addr {
host: "127.16.188.252"
port: 41941
}
attrs {
promote: true
}
}
dest_uuid: "468a04419f064f3b8a267c0cd9990914"
cas_config_opid_index: 6
I20260809 18:57:01.830027 26505 consensus_queue.cc:237] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } }
I20260809 18:57:01.832258 27436 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Refusing update from remote peer 468a04419f064f3b8a267c0cd9990914: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 18:57:01.832592 27574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:01.832948 27534 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 18:57:01.835855 27520 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 72dc4841ff3c4eaa93623a6557647d38 (127.16.188.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } } }
I20260809 18:57:01.836556 27436 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 72dc4841ff3c4eaa93623a6557647d38 (127.16.188.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } } }
I20260809 18:57:01.837332 27574 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Refusing update from remote peer 468a04419f064f3b8a267c0cd9990914: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 18:57:01.839923 27520 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.16.188.252:41941
I20260809 18:57:01.840394 27520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } } }
I20260809 18:57:01.840333 27534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } } }
I20260809 18:57:01.840976 27520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:01.841048 27534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:01.842905 27361 master.cc:537] Master@127.16.188.252:41941 shutting down...
I20260809 18:57:01.848325 27363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 18:57:01.852140 26483 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260809 18:57:01.852254 27487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } } }
I20260809 18:57:01.852494 27487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:57:01.857656 27544 tablet.cc:2369] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:57:01.859680 26483 consensus_peers.cc:487] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 -> Peer 72dc4841ff3c4eaa93623a6557647d38 (127.16.188.252:41941): Couldn't send request to peer 72dc4841ff3c4eaa93623a6557647d38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 18:57:01.869753 27361 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:01.870213 27361 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:01.870461 27361 tablet_replica.cc:330] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: stopping tablet replica
I20260809 18:57:01.877882 27361 master.cc:552] Master@127.16.188.252:41941 shutdown complete.
I20260809 18:57:01.877962 27361 master_runner.cc:305] Clearing existing system tablet
I20260809 18:57:01.878412 27361 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:01.878543 27361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:01.881654 27361 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:57:01.883291 27660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:01.883615 27361 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:01.883884 27361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:57:01.883999 27361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
uuid: "72dc4841ff3c4eaa93623a6557647d38"
format_stamp: "Formatted at 2026-08-09 18:57:01 on dist-test-slave-266d"
server_key: "deeb32a24e208928b0ec89cc45d24929"
server_key_iv: "7c6997ef1627adb02e733bb6f9d1bf5e"
server_key_version: "encryptionkey@0"
I20260809 18:57:01.888886 27361 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:01.896528 27361 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 18:57:01.896744 27361 log.cc:1196] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 18:57:01.897338 27361 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Deleting consensus metadata
I20260809 18:57:01.897609 27361 master_runner.cc:315] Copying system tablet from 127.16.188.254:33951
I20260809 18:57:01.903131 27361 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.254:33951
I20260809 18:57:01.920651 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.904043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35664 (local address 127.16.188.254:33951)
0809 18:57:01.904355 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:01.904362 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:01.905217 (+ 855us) server_negotiation.cc:407] Connection header received
0809 18:57:01.905395 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:01.905400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:01.905497 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:01.905600 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:01.907258 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.908364 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.910555 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.911207 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.911323 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.913988 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:01.913995 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:01.914000 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:01.914040 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:01.917550 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.918364 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.918369 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.918372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.918528 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:01.919010 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:01.919015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:01.919019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:01.919384 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:01.919540 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:01.920057 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 18:57:01.920310 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260809 18:57:01.921151 27670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:01.903935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:35664)
0809 18:57:01.905055 (+ 1120us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:01.905080 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:01.905273 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:01.905650 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:01.905655 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:01.906409 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:01.907053 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.907089 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.908537 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.908543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.910367 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:01.910386 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:01.911392 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:01.911400 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:01.911705 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:01.912515 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:01.912551 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:01.913783 (+ 1232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:01.917691 (+ 3908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.917697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.917702 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.918220 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.918654 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:01.918659 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:01.918663 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:01.918886 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:01.919523 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:01.919528 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:01.919759 (+ 231us) client_negotiation.cc:769] Sending connection context
0809 18:57:01.919929 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 18:57:01.920336 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"thread_start_us":697,"threads_started":1}
I20260809 18:57:01.921778 26538 tablet_copy_service.cc:140] P 468a04419f064f3b8a267c0cd9990914: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 72dc4841ff3c4eaa93623a6557647d38 ({username='oryx', principal='oryx/127.16.188.252@KRBTEST.COM'} at 127.0.0.1:35664)
I20260809 18:57:01.921948 26538 tablet_copy_service.cc:161] P 468a04419f064f3b8a267c0cd9990914: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 72dc4841ff3c4eaa93623a6557647d38 at {username='oryx', principal='oryx/127.16.188.252@KRBTEST.COM'} at 127.0.0.1:35664: session id = 72dc4841ff3c4eaa93623a6557647d38-00000000000000000000000000000000
I20260809 18:57:01.925642 26538 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 18:57:01.927825 27361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 18:57:01.932958 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 26605
I20260809 18:57:01.935039 27361 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: tablet copy: Starting download of 0 data blocks...
I20260809 18:57:01.935307 27361 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: tablet copy: Starting download of 1 WAL segments...
I20260809 18:57:01.940940 27361 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 18:57:01.945750 26538 tablet_copy_service.cc:342] P 468a04419f064f3b8a267c0cd9990914: Request end of tablet copy session 72dc4841ff3c4eaa93623a6557647d38-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.16.188.252@KRBTEST.COM'} at 127.0.0.1:35664
I20260809 18:57:01.945930 26538 tablet_copy_service.cc:433] P 468a04419f064f3b8a267c0cd9990914: ending tablet copy session 72dc4841ff3c4eaa93623a6557647d38-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 72dc4841ff3c4eaa93623a6557647d38
I20260809 18:57:01.957494 27361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:01.960302 27675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:01.963085 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:37189
--local_ip_for_outbound_sockets=127.16.188.193
--tserver_master_addrs=127.16.188.254:33951
--webserver_port=45357
--webserver_interface=127.16.188.193
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab
--principal=oryx/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709,127.16.188.252:41941 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:01.965987 27677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:01.974431 27361 server_base.cc:1034] running on GCE node
W20260809 18:57:01.974653 27682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:01.975085 27361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:01.975704 27361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:01.977010 27361 hybrid_clock.cc:648] HybridClock initialized: now 1786301821976973 us; error 28 us; skew 500 ppm
I20260809 18:57:01.977253 27361 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:01 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301821, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:01.979202 27361 init.cc:377] Logged in from keytab as oryx/127.16.188.252@KRBTEST.COM (short username oryx)
I20260809 18:57:01.986027 27361 webserver.cc:460] Webserver started at http://127.16.188.252:45285/ using document root <none> and password file <none>
I20260809 18:57:01.986332 27361 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:01.986428 27361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:01.988657 27361 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 18:57:01.990224 27695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:01.990630 27361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:57:01.990751 27361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
uuid: "72dc4841ff3c4eaa93623a6557647d38"
format_stamp: "Formatted at 2026-08-09 18:57:01 on dist-test-slave-266d"
server_key: "deeb32a24e208928b0ec89cc45d24929"
server_key_iv: "7c6997ef1627adb02e733bb6f9d1bf5e"
server_key_version: "encryptionkey@0"
I20260809 18:57:01.990916 27361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:02.012930 27361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:02.016350 27361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:02.046833 27361 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.252:41941
I20260809 18:57:02.046875 27780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.252:41941 every 8 connection(s)
I20260809 18:57:02.047704 27361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
I20260809 18:57:02.053503 27783 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:57:02.057753 27783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Bootstrap starting.
I20260809 18:57:02.073494 27783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:57:02.073943 27783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Bootstrap complete.
I20260809 18:57:02.074911 27783 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } }
I20260809 18:57:02.075276 27783 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72dc4841ff3c4eaa93623a6557647d38, State: Initialized, Role: LEARNER
I20260809 18:57:02.075527 27783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } }
I20260809 18:57:02.077522 27791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } } }
I20260809 18:57:02.077821 27783 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:02.078001 27791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:57:02.099709 27810 catalog_manager.cc:1259] Loaded cluster ID: bf6bff7a61674e86894e549cfae3bbe5
I20260809 18:57:02.099817 27810 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: loading cluster ID for follower catalog manager: success
I20260809 18:57:02.102252 27810 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: acquiring CA information for follower catalog manager: success
I20260809 18:57:02.104133 27810 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:57:02.296146 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.288490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47762 (local address 127.16.188.252:41941)
0809 18:57:02.289336 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.289343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.289366 (+ 23us) server_negotiation.cc:407] Connection header received
0809 18:57:02.289445 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.289452 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.289539 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.289674 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:02.290184 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.291942 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.294279 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.295136 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.295307 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.295443 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.295719 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.295830 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":491,"threads_started":1}
I20260809 18:57:02.296283 27523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.288305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41941 (local address 127.0.0.1:47762)
0809 18:57:02.288584 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.288606 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.288753 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.289747 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.289753 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.289792 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:02.289996 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.290008 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.292112 (+ 2104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.292119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.294090 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.294109 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.295325 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.295332 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.295527 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.295567 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.295694 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.295846 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
I20260809 18:57:02.297554 27735 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.7] Dedup: 1.7->[]
I20260809 18:57:02.298206 27791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 468a04419f064f3b8a267c0cd9990914. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } } }
I20260809 18:57:02.298516 27791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: This master's current role is: LEARNER
W20260809 18:57:02.421466 27686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:02.421761 27686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:02.421904 27686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:02.430464 27686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:02.430655 27686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:02.430874 27686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:57:02.441998 27686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab
--principal=oryx/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:37189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=45357
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709,127.16.188.252:41941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:02.443284 27686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:02.444550 27686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:02.461781 27817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:02.461844 27818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:02.462548 27821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:02.464118 27686 server_base.cc:1034] running on GCE node
I20260809 18:57:02.464869 27686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:02.466068 27686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:02.467280 27686 hybrid_clock.cc:648] HybridClock initialized: now 1786301822467232 us; error 36 us; skew 500 ppm
I20260809 18:57:02.467653 27686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:02 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301822, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:02.471925 27686 init.cc:377] Logged in from keytab as oryx/127.16.188.193@KRBTEST.COM (short username oryx)
I20260809 18:57:02.473994 27686 webserver.cc:460] Webserver started at http://127.16.188.193:45357/ using document root <none> and password file <none>
I20260809 18:57:02.474988 27686 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:02.475208 27686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:02.482194 27686 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:57:02.485951 27830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:02.487500 27686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 18:57:02.487703 27686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "34bf4f29eab445369fca62c74983c34f"
format_stamp: "Formatted at 2026-08-09 18:56:59 on dist-test-slave-266d"
server_key: "cb36ff878f2706990e63662e7b8ff7af"
server_key_iv: "73bc0c500a0eb415b0d49308150bf0f9"
server_key_version: "encryptionkey@0"
I20260809 18:57:02.489114 27686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:02.510957 27686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:02.516183 27686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:02.516556 27686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:02.517730 27686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:02.519156 27686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:02.519246 27686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:02.519356 27686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:02.519431 27686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:02.561370 27686 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:37189
I20260809 18:57:02.561642 28009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:37189 every 8 connection(s)
I20260809 18:57:02.563056 27686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:02.564590 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 27686
I20260809 18:57:02.565014 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 26792
Aug 09 18:57:02 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301822, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.252@KRBTEST.COM
Aug 09 18:57:02 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301822, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
Aug 09 18:57:02 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.194@KRBTEST.COM
I20260809 18:57:02.595170 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.568032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:37915 (local address 127.16.188.252:41941)
0809 18:57:02.568220 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.568226 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.568849 (+ 623us) server_negotiation.cc:407] Connection header received
0809 18:57:02.572349 (+ 3500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.572357 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.572460 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.572537 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:02.575501 (+ 2964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.576880 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.580332 (+ 3452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.581272 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.581381 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.587401 (+ 6020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:02.587408 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:02.587412 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:02.587478 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:02.590922 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:02.592021 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:02.592027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:02.592030 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:02.592172 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:02.592754 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:02.592760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:02.592763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:02.593213 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:02.593410 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.594603 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.594831 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 18:57:02.597616 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.567146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41941 (local address 127.16.188.193:37915)
0809 18:57:02.568652 (+ 1506us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.568713 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.571973 (+ 3260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.573205 (+ 1232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.573217 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.574256 (+ 1039us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:02.575220 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.575246 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.577163 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.577169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.580137 (+ 2968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.580155 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.581872 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.581880 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.582262 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.583255 (+ 993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:02.583290 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:02.587119 (+ 3829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:02.591061 (+ 3942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:02.591069 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:02.591084 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:02.591839 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:02.592333 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:02.592337 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:02.592341 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:02.592616 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:02.593593 (+ 977us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:02.593650 (+ 57us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:02.594145 (+ 495us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.595449 (+ 1304us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.596004 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1102,"thread_start_us":1691,"threads_started":1}
I20260809 18:57:02.599614 28011 heartbeater.cc:347] Connected to a master server at 127.16.188.252:41941
I20260809 18:57:02.600066 28011 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:02.601385 28011 heartbeater.cc:511] Master 127.16.188.252:41941 requested a full tablet report, sending...
I20260809 18:57:02.602723 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.568618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.193:51233)
0809 18:57:02.579849 (+ 11231us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.579870 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.580013 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.583450 (+ 3437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.583454 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.584349 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:02.584673 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.584696 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.587263 (+ 2567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.587268 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.589244 (+ 1976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.589260 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.590441 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.590448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.590632 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.591293 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:02.591316 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:02.594420 (+ 3104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:02.599050 (+ 4630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:02.599054 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:02.599057 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:02.599930 (+ 873us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:02.600453 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:02.600458 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:02.600461 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:02.600671 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:02.601573 (+ 902us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:02.601578 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:02.601752 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.601884 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.602155 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11073,"thread_start_us":11458,"threads_started":1}
I20260809 18:57:02.604076 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.566779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:51233 (local address 127.16.188.254:33951)
0809 18:57:02.582826 (+ 16047us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.582830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.582849 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:57:02.582912 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.582919 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.582998 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.583118 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:02.585515 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.587064 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.589422 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.590069 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.590188 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.594622 (+ 4434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:02.594628 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:02.594632 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:02.594668 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:02.598447 (+ 3779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:02.600071 (+ 1624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:02.600076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:02.600079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:02.600308 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:02.600825 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:02.600832 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:02.600836 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:02.601289 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:02.601434 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.603384 (+ 1950us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.603640 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15933,"thread_start_us":16952,"threads_started":1}
I20260809 18:57:02.604367 27720 ts_manager.cc:194] Registered new tserver with Master: 34bf4f29eab445369fca62c74983c34f (127.16.188.193:37189)
I20260809 18:57:02.605355 28012 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33951
I20260809 18:57:02.605540 28012 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:02.605967 28017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.566275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41324 (local address 127.16.188.194:41977)
0809 18:57:02.566920 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.566928 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.578630 (+ 11702us) server_negotiation.cc:407] Connection header received
0809 18:57:02.579151 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.579161 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.579436 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.579577 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:02.583319 (+ 3742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.585102 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.587254 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.588121 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.588220 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.595213 (+ 6993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:02.595228 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:02.595245 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:02.595295 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:02.601040 (+ 5745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:02.602062 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:02.602070 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:02.602074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:02.602341 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:02.602872 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:02.602877 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:02.602880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:02.603366 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:02.603751 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.604660 (+ 909us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.605392 (+ 732us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":612,"threads_started":1}
I20260809 18:57:02.606808 28012 heartbeater.cc:511] Master 127.16.188.254:33951 requested a full tablet report, sending...
Aug 09 18:57:02 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301822, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.253@KRBTEST.COM
I20260809 18:57:02.608405 26986 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:02.608783 26505 ts_manager.cc:194] Re-registered known tserver with Master: 34bf4f29eab445369fca62c74983c34f (127.16.188.193:37189)
I20260809 18:57:02.610119 26505 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:51233
I20260809 18:57:02.616825 28030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.582220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.16.188.193:43155)
0809 18:57:02.594335 (+ 12115us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:02.594353 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:02.594475 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:02.595105 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:02.595109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:02.596225 (+ 1116us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:02.596843 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.596859 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.598847 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.598852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.602112 (+ 3260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:02.602128 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.603749 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.603757 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:02.604014 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.604671 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:02.604691 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:02.608816 (+ 4125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:02.614136 (+ 5320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:02.614140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:02.614142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:02.614568 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:02.615032 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:02.615035 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:02.615037 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:02.615266 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:02.615892 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:02.615895 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:02.616032 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 18:57:02.616147 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 18:57:02.616397 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11976,"thread_start_us":11665,"threads_started":1}
I20260809 18:57:02.617389 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:02.582708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:43155 (local address 127.16.188.253:45709)
0809 18:57:02.584508 (+ 1800us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:02.584514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:02.594584 (+ 10070us) server_negotiation.cc:407] Connection header received
0809 18:57:02.594711 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:02.594717 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:02.594800 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:02.594903 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:02.597083 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.598709 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.602300 (+ 3591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:02.603161 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:02.603294 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:02.609121 (+ 5827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:02.609129 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:02.609133 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:02.609173 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:02.613995 (+ 4822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:02.614701 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:02.614707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:02.614711 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:02.614937 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:02.615372 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:02.615376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:02.615380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:02.615794 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:02.615985 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:02.616329 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 18:57:02.616623 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1683,"thread_start_us":1587,"threads_started":1}
I20260809 18:57:02.618510 28014 heartbeater.cc:347] Connected to a master server at 127.16.188.253:45709
I20260809 18:57:02.618701 28014 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:02.619289 28014 heartbeater.cc:511] Master 127.16.188.253:45709 requested a full tablet report, sending...
I20260809 18:57:02.621371 27420 ts_manager.cc:194] Registered new tserver with Master: 34bf4f29eab445369fca62c74983c34f (127.16.188.193:37189)
I20260809 18:57:02.694079 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 26792
I20260809 18:57:02.716336 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:41977
--local_ip_for_outbound_sockets=127.16.188.194
--tserver_master_addrs=127.16.188.254:33951
--webserver_port=44125
--webserver_interface=127.16.188.194
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab
--principal=oryx/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709,127.16.188.252:41941 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:57:02.863960 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: NON_VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: true } } }
I20260809 18:57:02.864320 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:02.866124 27363 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: attempting to promote NON_VOTER 72dc4841ff3c4eaa93623a6557647d38 to VOTER
I20260809 18:57:02.866680 27363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } }
I20260809 18:57:02.868866 27436 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Refusing update from remote peer 468a04419f064f3b8a267c0cd9990914: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 18:57:02.868923 27735 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 LEARNER]: Refusing update from remote peer 468a04419f064f3b8a267c0cd9990914: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 18:57:02.869468 28037 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 18:57:02.869889 28035 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 18:57:02.873744 28037 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 72dc4841ff3c4eaa93623a6557647d38 (127.16.188.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:02.874580 27436 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 72dc4841ff3c4eaa93623a6557647d38 (127.16.188.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:02.875502 27735 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 72dc4841ff3c4eaa93623a6557647d38 (127.16.188.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:02.877919 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:02.878387 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:02.878679 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:02.879086 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:02.879537 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:02.880007 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:02.884331 28042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:02.884663 28042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:57:02.885190 28043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "468a04419f064f3b8a267c0cd9990914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:02.885568 28043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:57:03.044448 28034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:03.044742 28034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:03.044866 28034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:03.055199 28034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:03.055323 28034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:03.055503 28034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:57:03.067548 28034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab
--principal=oryx/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:41977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=44125
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709,127.16.188.252:41941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:03.068722 28034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:03.070022 28034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:03.082536 28058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:03.082608 28054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:03.082582 28053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:03.083541 28034 server_base.cc:1034] running on GCE node
I20260809 18:57:03.084108 28034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:03.084959 28034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:03.086159 28034 hybrid_clock.cc:648] HybridClock initialized: now 1786301823086100 us; error 45 us; skew 500 ppm
I20260809 18:57:03.086488 28034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301823, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:03.089458 28034 init.cc:377] Logged in from keytab as oryx/127.16.188.194@KRBTEST.COM (short username oryx)
I20260809 18:57:03.090736 28034 webserver.cc:460] Webserver started at http://127.16.188.194:44125/ using document root <none> and password file <none>
I20260809 18:57:03.091434 28034 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:03.091564 28034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:03.096962 28034 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:03.099625 28071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:03.100841 28034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:57:03.100991 28034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "880fce2d9251422f815f9a329a618a61"
format_stamp: "Formatted at 2026-08-09 18:56:59 on dist-test-slave-266d"
server_key: "4188e960df6d8c68b52a548aad360750"
server_key_iv: "454d86e5c70220a719e066ce25c03506"
server_key_version: "encryptionkey@0"
I20260809 18:57:03.101956 28034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:03.113162 28034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:03.116588 28034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:03.116842 28034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:03.117799 28034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:03.119052 28034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:03.119156 28034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:03.119264 28034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:03.119335 28034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:03.148481 28034 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:41977
I20260809 18:57:03.148546 28238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:41977 every 8 connection(s)
I20260809 18:57:03.149914 28034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:03.157392 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 28034
I20260809 18:57:03.157688 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 27000
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301823, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301823, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.252@KRBTEST.COM
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.195@KRBTEST.COM
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301823, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.253@KRBTEST.COM
I20260809 18:57:03.194911 28247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.152719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:55339 (local address 127.16.188.252:41941)
0809 18:57:03.173275 (+ 20556us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.173281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.173300 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:57:03.173357 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.173361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.173435 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.174237 (+ 802us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.175546 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.176848 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.179406 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.179900 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.180012 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.185460 (+ 5448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.185466 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.185470 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.185513 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.190760 (+ 5247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.191668 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.191673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.191676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.191821 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.192465 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.192470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.192473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.192913 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.193102 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.193919 (+ 817us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.194169 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20424,"thread_start_us":21017,"threads_started":1}
I20260809 18:57:03.195170 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.153023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:60021 (local address 127.16.188.253:45709)
0809 18:57:03.173161 (+ 20138us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.173168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.173188 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:57:03.173297 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.173303 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.173386 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.173491 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.175523 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.176634 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.180613 (+ 3979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.181300 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.181423 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.186038 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.186042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.186045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.186077 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.190444 (+ 4367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.191655 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.191661 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.191664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.191859 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.192829 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.192834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.192838 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.193393 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.193606 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.194340 (+ 734us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.194649 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19976,"thread_start_us":19768,"threads_started":1}
I20260809 18:57:03.196276 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.158757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58146 (local address 127.16.188.195:43579)
0809 18:57:03.168834 (+ 10077us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.168840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.168863 (+ 23us) server_negotiation.cc:407] Connection header received
0809 18:57:03.168920 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.168925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.169112 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.169285 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.172668 (+ 3383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.174504 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.177433 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.178335 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.178471 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.186743 (+ 8272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.186756 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.186770 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.186816 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.191288 (+ 4472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.192024 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.192033 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.192036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.192320 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.193279 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.193285 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.193289 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.193778 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.194080 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.195519 (+ 1439us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.195735 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9925,"thread_start_us":9783,"threads_started":1}
I20260809 18:57:03.196681 28253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.153570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.16.188.194:60021)
0809 18:57:03.163862 (+ 10292us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.163915 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.172505 (+ 8590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.173795 (+ 1290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.173800 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.174540 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:03.175292 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.175335 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.176808 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.176813 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.179273 (+ 2460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.180448 (+ 1175us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.181713 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.181722 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.181936 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.182568 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:03.182591 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:03.185863 (+ 3272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:03.190644 (+ 4781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.190654 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.190672 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.191489 (+ 817us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.192070 (+ 581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.192075 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.192083 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.192657 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.193691 (+ 1034us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:03.193696 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:03.193874 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.194015 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.195827 (+ 1812us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9942,"mutex_wait_us":1734,"thread_start_us":9705,"threads_started":1}
I20260809 18:57:03.198172 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.154361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.194:40997)
0809 18:57:03.168052 (+ 13691us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.168066 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.171670 (+ 3604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.172618 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.172632 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.173995 (+ 1363us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:03.175369 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.175386 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.176580 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.176586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.179190 (+ 2604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.179223 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.180349 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.180356 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.180498 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.181463 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:03.181483 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:03.185464 (+ 3981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:03.192032 (+ 6568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.192037 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.192041 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.192824 (+ 783us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.195409 (+ 2585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.195414 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.195417 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.195596 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.197054 (+ 1458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:03.197059 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:03.197244 (+ 185us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.197408 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.197640 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13584,"mutex_wait_us":374,"thread_start_us":12262,"threads_started":1}
I20260809 18:57:03.198167 27192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:03.198496 28257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.153894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41941 (local address 127.16.188.194:55339)
0809 18:57:03.167185 (+ 13291us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.167205 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.171670 (+ 4465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.173610 (+ 1940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.173615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.174432 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:03.175383 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.175394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.177026 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.177031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.179190 (+ 2159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.179281 (+ 91us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.180114 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.180122 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.180406 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.181280 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:03.181311 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:03.185158 (+ 3847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:03.190880 (+ 5722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.190885 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.190890 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.191521 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.191940 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.191945 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.191948 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.192319 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.193011 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:03.193019 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:03.193511 (+ 492us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.193779 (+ 268us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.194294 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13134,"mutex_wait_us":163,"spinlock_wait_cycles":16256,"thread_start_us":13151,"threads_started":1}
I20260809 18:57:03.199182 28252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.153040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:40997 (local address 127.16.188.254:33951)
0809 18:57:03.165458 (+ 12418us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.165465 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.168156 (+ 2691us) server_negotiation.cc:407] Connection header received
0809 18:57:03.172072 (+ 3916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.172078 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.172236 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.172340 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.175517 (+ 3177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.176425 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.179343 (+ 2918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.180147 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.180278 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.185672 (+ 5394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.185679 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.185683 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.185736 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.190631 (+ 4895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.192951 (+ 2320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.192956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.192959 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.193152 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.195713 (+ 2561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.195718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.195721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.196057 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.196192 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.198014 (+ 1822us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.198443 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12296,"thread_start_us":12395,"threads_started":1}
I20260809 18:57:03.200301 28240 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33951
I20260809 18:57:03.200682 28240 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:03.201727 28240 heartbeater.cc:511] Master 127.16.188.254:33951 requested a full tablet report, sending...
I20260809 18:57:03.201993 28242 heartbeater.cc:347] Connected to a master server at 127.16.188.253:45709
I20260809 18:57:03.202214 28242 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:03.201748 28239 heartbeater.cc:347] Connected to a master server at 127.16.188.252:41941
I20260809 18:57:03.202705 28239 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:03.203154 28242 heartbeater.cc:511] Master 127.16.188.253:45709 requested a full tablet report, sending...
I20260809 18:57:03.203223 28239 heartbeater.cc:511] Master 127.16.188.252:41941 requested a full tablet report, sending...
I20260809 18:57:03.204401 26505 ts_manager.cc:194] Re-registered known tserver with Master: 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977)
I20260809 18:57:03.204758 27720 ts_manager.cc:194] Registered new tserver with Master: 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977)
I20260809 18:57:03.205418 26505 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:40997
I20260809 18:57:03.205878 27420 ts_manager.cc:194] Registered new tserver with Master: 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977)
I20260809 18:57:03.294826 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 27000
W20260809 18:57:03.317054 26483 connection.cc:535] server connection from 127.16.188.195:60735 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 18:57:03.317854 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:43579
--local_ip_for_outbound_sockets=127.16.188.195
--tserver_master_addrs=127.16.188.254:33951
--webserver_port=42127
--webserver_interface=127.16.188.195
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab
--principal=oryx/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709,127.16.188.252:41941 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:57:03.613989 28012 heartbeater.cc:503] Master 127.16.188.254:33951 was elected leader, sending a full tablet report...
W20260809 18:57:03.649765 28266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:03.650022 28266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:03.650123 28266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:03.657249 28266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:03.657346 28266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:03.657465 28266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:57:03.666999 28266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab
--principal=oryx/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:43579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=42127
--tserver_master_addrs=127.16.188.254:33951,127.16.188.253:45709,127.16.188.252:41941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:03.668536 28266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:03.669903 28266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:03.682902 28275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:03.682883 28279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:03.682987 28276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:03.683948 28266 server_base.cc:1034] running on GCE node
I20260809 18:57:03.684485 28266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:03.685386 28266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:03.686584 28266 hybrid_clock.cc:648] HybridClock initialized: now 1786301823686527 us; error 48 us; skew 500 ppm
I20260809 18:57:03.686892 28266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301823, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:03.689927 28266 init.cc:377] Logged in from keytab as oryx/127.16.188.195@KRBTEST.COM (short username oryx)
I20260809 18:57:03.691325 28266 webserver.cc:460] Webserver started at http://127.16.188.195:42127/ using document root <none> and password file <none>
I20260809 18:57:03.691984 28266 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:03.692124 28266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:03.697682 28266 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 18:57:03.700250 28299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:03.701583 28266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:03.701740 28266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "4212fc9479d44bc6a7369bd43623e133"
format_stamp: "Formatted at 2026-08-09 18:57:00 on dist-test-slave-266d"
server_key: "98b898fa95e57e51593e7289b01177e5"
server_key_iv: "e44721751c6d64f01fe275ed54612d87"
server_key_version: "encryptionkey@0"
I20260809 18:57:03.702672 28266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:03.726717 28266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:03.730480 28266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:03.730747 28266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:03.731714 28266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:03.733069 28266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:03.733191 28266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:03.733299 28266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:03.733369 28266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:03.765079 28266 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:43579
I20260809 18:57:03.765151 28470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:43579 every 8 connection(s)
I20260809 18:57:03.766482 28266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:03.770571 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 28266
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301823, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301823, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.252@KRBTEST.COM
Aug 09 18:57:03 dist-test-slave-266d krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301823, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.253@KRBTEST.COM
I20260809 18:57:03.823540 28476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.769262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:43479 (local address 127.16.188.254:33951)
0809 18:57:03.780576 (+ 11314us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.780584 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.781821 (+ 1237us) server_negotiation.cc:407] Connection header received
0809 18:57:03.784214 (+ 2393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.784220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.784311 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.784410 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.786383 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.787388 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.792525 (+ 5137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.793294 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.793412 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.814457 (+ 21045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.814466 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.814472 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.814526 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.819097 (+ 4571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.820651 (+ 1554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.820657 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.820661 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.820884 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.821421 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.821427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.821430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.821836 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.822013 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.822803 (+ 790us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.823050 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11162,"thread_start_us":11322,"threads_started":1}
I20260809 18:57:03.825351 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.769219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:51587 (local address 127.16.188.253:45709)
0809 18:57:03.786089 (+ 16870us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.786095 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.786114 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:57:03.786171 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.786176 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.786251 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.788102 (+ 1851us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.788665 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.789933 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.792381 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.793189 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.793279 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.807659 (+ 14380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.807668 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.807673 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.807748 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.812305 (+ 4557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.814694 (+ 2389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.814700 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.814705 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.814970 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.819973 (+ 5003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.819979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.819982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.820358 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.820489 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.824451 (+ 3962us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.824779 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16743,"thread_start_us":16628,"threads_started":1}
I20260809 18:57:03.826108 28481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.770834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:49389 (local address 127.16.188.252:41941)
0809 18:57:03.786509 (+ 15675us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.786516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.786538 (+ 22us) server_negotiation.cc:407] Connection header received
0809 18:57:03.786599 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.786604 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.786703 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.786821 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.787985 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.789084 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.791544 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.792191 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.792317 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.802324 (+ 10007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.802333 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.802337 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.802382 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.808528 (+ 6146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.816836 (+ 8308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.816843 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.816847 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.817136 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.818150 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.818156 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.818160 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.818653 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.818794 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.825447 (+ 6653us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.825725 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15549,"thread_start_us":15458,"threads_started":1}
I20260809 18:57:03.827376 28478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.769887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.16.188.195:51587)
0809 18:57:03.782316 (+ 12429us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.782339 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.784292 (+ 1953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.787358 (+ 3066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.787362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.788029 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:03.788493 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.788507 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.790129 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.790134 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.792234 (+ 2100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.792249 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.799229 (+ 6980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.799239 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.799941 (+ 702us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.801021 (+ 1080us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:03.801046 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:03.807049 (+ 6003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:03.812560 (+ 5511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.812569 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.812591 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.813443 (+ 852us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.815170 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.815175 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.815179 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.819743 (+ 4564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.821061 (+ 1318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:03.821066 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:03.821335 (+ 269us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.826018 (+ 4683us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.826750 (+ 732us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12281,"mutex_wait_us":473,"thread_start_us":11695,"threads_started":1}
I20260809 18:57:03.830627 28477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.769887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.195:43479)
0809 18:57:03.781284 (+ 11397us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.781345 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.783924 (+ 2579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.784650 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.784659 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.785331 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:03.786200 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.786225 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.787985 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.787990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.792300 (+ 4310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.792314 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.793794 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.793803 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.794093 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.795419 (+ 1326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:03.795457 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:03.800705 (+ 5248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:03.819969 (+ 19264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.819975 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.819980 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.820524 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.820981 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.820986 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.820989 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.821296 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.821942 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:03.821947 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:03.822527 (+ 580us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.822735 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.823466 (+ 731us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11052,"mutex_wait_us":741,"spinlock_wait_cycles":698240,"thread_start_us":10809,"threads_started":1}
I20260809 18:57:03.831107 28473 heartbeater.cc:347] Connected to a master server at 127.16.188.253:45709
I20260809 18:57:03.831553 28473 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:03.832063 28480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.770401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41941 (local address 127.16.188.195:49389)
0809 18:57:03.785547 (+ 15146us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.785564 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.785678 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.786857 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.786862 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.787424 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:03.787820 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.787832 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.789277 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.789282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.791386 (+ 2104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.791402 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.794578 (+ 3176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.794585 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.794881 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.796525 (+ 1644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:03.796546 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:03.802006 (+ 5460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:03.813321 (+ 11315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.813326 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.813331 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.816293 (+ 2962us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.817333 (+ 1040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:03.817339 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:03.817343 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:03.817596 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:03.818930 (+ 1334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:03.818941 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:03.819464 (+ 523us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.826466 (+ 7002us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.827838 (+ 1372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15025,"mutex_wait_us":1110,"thread_start_us":14892,"threads_started":1}
I20260809 18:57:03.832093 28472 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33951
I20260809 18:57:03.832351 28472 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:03.833362 28471 heartbeater.cc:347] Connected to a master server at 127.16.188.252:41941
I20260809 18:57:03.833514 28471 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:03.833823 28472 heartbeater.cc:511] Master 127.16.188.254:33951 requested a full tablet report, sending...
I20260809 18:57:03.834031 28471 heartbeater.cc:511] Master 127.16.188.252:41941 requested a full tablet report, sending...
I20260809 18:57:03.834656 28473 heartbeater.cc:511] Master 127.16.188.253:45709 requested a full tablet report, sending...
I20260809 18:57:03.835963 27720 ts_manager.cc:194] Registered new tserver with Master: 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579)
I20260809 18:57:03.836222 27420 ts_manager.cc:194] Registered new tserver with Master: 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579)
I20260809 18:57:03.838800 26505 ts_manager.cc:194] Re-registered known tserver with Master: 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579)
I20260809 18:57:03.840220 26505 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:43479
I20260809 18:57:03.853137 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.793544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53602 (local address 127.16.188.253:45709)
0809 18:57:03.825938 (+ 32394us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.825944 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.828205 (+ 2261us) server_negotiation.cc:407] Connection header received
0809 18:57:03.828572 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.828577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.828721 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.828794 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.832443 (+ 3649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.833640 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.836339 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.837285 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.837380 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.844885 (+ 7505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.844893 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.844897 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.844944 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.849307 (+ 4363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.850169 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.850175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.850178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.850426 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.850973 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.850979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.850983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.851397 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.851689 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.852241 (+ 552us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.852708 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32288,"thread_start_us":32385,"threads_started":1}
I20260809 18:57:03.854921 28481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.803829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47776 (local address 127.16.188.252:41941)
0809 18:57:03.826385 (+ 22556us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.826390 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.832099 (+ 5709us) server_negotiation.cc:407] Connection header received
0809 18:57:03.832626 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.832632 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.832733 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.832807 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.838796 (+ 5989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.840021 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.842409 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.843129 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.843230 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.847038 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.847047 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.847051 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.847093 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.851022 (+ 3929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.852203 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.852209 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.852213 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.852396 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.852965 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.852970 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.852973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.853395 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.853708 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.854295 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.854527 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22412,"thread_start_us":23418,"threads_started":1}
I20260809 18:57:03.861922 28476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.793657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35680 (local address 127.16.188.254:33951)
0809 18:57:03.824150 (+ 30493us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.824156 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.830135 (+ 5979us) server_negotiation.cc:407] Connection header received
0809 18:57:03.830194 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.830199 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.830325 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.830428 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:03.841195 (+ 10767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.842361 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.849079 (+ 6718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.850036 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.850227 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.855146 (+ 4919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:03.855154 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:03.855158 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:03.855205 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:03.858999 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.859691 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.859694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.859697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.859895 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:03.860298 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:03.860302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:03.860304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:03.860698 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:03.860971 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.861223 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.861434 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30376,"thread_start_us":36250,"threads_started":1}
I20260809 18:57:03.866144 26505 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:03.876240 26505 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:03.910320 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.896733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38308 (local address 127.16.188.193:37189)
0809 18:57:03.897300 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.897307 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.898308 (+ 1001us) server_negotiation.cc:407] Connection header received
0809 18:57:03.898535 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.898541 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.898745 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.898943 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:03.899606 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.901742 (+ 2136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.906122 (+ 4380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.908420 (+ 2298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.908594 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.908792 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.909628 (+ 836us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.909858 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":242,"threads_started":1}
I20260809 18:57:03.911556 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.896768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38308)
0809 18:57:03.898197 (+ 1429us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.898218 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.898391 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.898945 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.898949 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.898977 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:03.899379 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.899394 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.901896 (+ 2502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.901901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.905861 (+ 3960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.905879 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.909122 (+ 3243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.909131 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.909375 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.909417 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.910690 (+ 1273us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.910830 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1219,"mutex_wait_us":1,"thread_start_us":4498,"threads_started":1}
I20260809 18:57:03.916296 27915 tablet_service.cc:1467] Processing CreateTablet for tablet 01697cfc7b8c48d3bc18705c4fc729f3 (DEFAULT_TABLE table=test-table [id=0c9a95f5b78f44808b0d5825c99844a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:03.918059 27915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01697cfc7b8c48d3bc18705c4fc729f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:03.918807 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.897657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41336 (local address 127.16.188.194:41977)
0809 18:57:03.898174 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.898180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.901588 (+ 3408us) server_negotiation.cc:407] Connection header received
0809 18:57:03.901813 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.901819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.902210 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.902417 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:03.905080 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.907963 (+ 2883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.911368 (+ 3405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.917069 (+ 5701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.917286 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.917456 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.918295 (+ 839us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.918464 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":236,"threads_started":1}
I20260809 18:57:03.919700 28515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.897440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:41977 (local address 127.0.0.1:41336)
0809 18:57:03.901472 (+ 4032us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.901486 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.901658 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.903642 (+ 1984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.903647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.903678 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:03.904752 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.904766 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.908168 (+ 3402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.908173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.911147 (+ 2974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.911162 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.917702 (+ 6540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.917710 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.917945 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.917981 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.918084 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.919152 (+ 1068us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3933,"thread_start_us":330,"threads_started":1}
I20260809 18:57:03.923318 28143 tablet_service.cc:1467] Processing CreateTablet for tablet 01697cfc7b8c48d3bc18705c4fc729f3 (DEFAULT_TABLE table=test-table [id=0c9a95f5b78f44808b0d5825c99844a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:03.924789 28143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01697cfc7b8c48d3bc18705c4fc729f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:03.927445 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.901609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43579 (local address 127.0.0.1:58158)
0809 18:57:03.911856 (+ 10247us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:03.911873 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:03.911961 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:03.918999 (+ 7038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:03.919004 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:03.919028 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:03.919308 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.919321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.921872 (+ 2551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.921877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.924059 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:03.924075 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.926594 (+ 2519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.926602 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:03.926823 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.926858 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:57:03.926953 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 18:57:03.927098 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10152,"thread_start_us":10437,"threads_started":1}
I20260809 18:57:03.928021 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.902429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58158 (local address 127.16.188.195:43579)
0809 18:57:03.917991 (+ 15562us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.917999 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:03.918035 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:57:03.918140 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:03.918147 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:03.918378 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:03.918594 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:03.919605 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.921688 (+ 2083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.924252 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:03.926346 (+ 2094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:03.926540 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:03.926750 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:03.927028 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 18:57:03.927177 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15340,"thread_start_us":15022,"threads_started":1}
I20260809 18:57:03.932368 28367 tablet_service.cc:1467] Processing CreateTablet for tablet 01697cfc7b8c48d3bc18705c4fc729f3 (DEFAULT_TABLE table=test-table [id=0c9a95f5b78f44808b0d5825c99844a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:03.934096 28367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01697cfc7b8c48d3bc18705c4fc729f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:03.936822 28523 tablet_bootstrap.cc:492] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Bootstrap starting.
I20260809 18:57:03.942185 28523 tablet_bootstrap.cc:654] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:03.943336 28524 tablet_bootstrap.cc:492] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: Bootstrap starting.
I20260809 18:57:03.944679 28523 log.cc:824] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:03.947847 28523 tablet_bootstrap.cc:492] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: No bootstrap required, opened a new log
I20260809 18:57:03.948179 28523 ts_tablet_manager.cc:1397] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260809 18:57:03.948505 28524 tablet_bootstrap.cc:654] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:03.950544 28524 log.cc:824] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:03.952131 28528 tablet_bootstrap.cc:492] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Bootstrap starting.
I20260809 18:57:03.957564 28528 tablet_bootstrap.cc:654] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:03.960033 28528 log.cc:824] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:03.960703 28524 tablet_bootstrap.cc:492] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: No bootstrap required, opened a new log
I20260809 18:57:03.961071 28524 ts_tablet_manager.cc:1397] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20260809 18:57:03.961611 28523 raft_consensus.cc:348] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:03.962033 28523 raft_consensus.cc:374] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:03.962162 28523 raft_consensus.cc:729] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bf4f29eab445369fca62c74983c34f, State: Initialized, Role: FOLLOWER
I20260809 18:57:03.962918 28523 consensus_queue.cc:260] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:03.965143 28523 ts_tablet_manager.cc:1428] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Time spent starting tablet: real 0.017s user 0.017s sys 0.001s
I20260809 18:57:03.964301 28528 tablet_bootstrap.cc:492] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: No bootstrap required, opened a new log
I20260809 18:57:03.965818 28528 ts_tablet_manager.cc:1397] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260809 18:57:03.973692 28524 raft_consensus.cc:348] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:03.974269 28524 raft_consensus.cc:374] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:03.974433 28524 raft_consensus.cc:729] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880fce2d9251422f815f9a329a618a61, State: Initialized, Role: FOLLOWER
I20260809 18:57:03.975109 28524 consensus_queue.cc:260] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:03.976676 28240 heartbeater.cc:503] Master 127.16.188.254:33951 was elected leader, sending a full tablet report...
I20260809 18:57:03.977265 28524 ts_tablet_manager.cc:1428] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: Time spent starting tablet: real 0.016s user 0.014s sys 0.002s
I20260809 18:57:03.979702 28528 raft_consensus.cc:348] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:03.980273 28528 raft_consensus.cc:374] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:03.980439 28528 raft_consensus.cc:729] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4212fc9479d44bc6a7369bd43623e133, State: Initialized, Role: FOLLOWER
I20260809 18:57:03.981137 28528 consensus_queue.cc:260] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:03.982733 28472 heartbeater.cc:503] Master 127.16.188.254:33951 was elected leader, sending a full tablet report...
I20260809 18:57:03.983222 28528 ts_tablet_manager.cc:1428] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Time spent starting tablet: real 0.017s user 0.008s sys 0.009s
I20260809 18:57:03.996328 28533 raft_consensus.cc:482] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:03.996694 28533 raft_consensus.cc:504] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:03.998843 28533 leader_election.cc:288] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579), 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977)
I20260809 18:57:04.010797 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.999251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:36097 (local address 127.16.188.194:41977)
0809 18:57:03.999424 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.999431 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:04.000615 (+ 1184us) server_negotiation.cc:407] Connection header received
0809 18:57:04.000809 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:04.000814 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:04.000884 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:04.000969 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:04.002420 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.003728 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.007863 (+ 4135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.009527 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.009701 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.009762 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:04.010369 (+ 607us) server_negotiation.cc:299] Negotiation successful
0809 18:57:04.010494 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 18:57:04.010819 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.998947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:52741 (local address 127.16.188.195:43579)
0809 18:57:03.999194 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:03.999201 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:04.000568 (+ 1367us) server_negotiation.cc:407] Connection header received
0809 18:57:04.000809 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:04.000815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:04.000884 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:04.000969 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:04.002262 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.003682 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.007832 (+ 4150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.009519 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.009687 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.009762 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:04.010368 (+ 606us) server_negotiation.cc:299] Negotiation successful
0809 18:57:04.010494 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 18:57:04.011300 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.999029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:41977 (local address 127.16.188.193:36097)
0809 18:57:04.000524 (+ 1495us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:04.000539 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:04.000693 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:04.001002 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:04.001007 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:04.001114 (+ 107us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:04.002145 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:04.002155 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.003849 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.003853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:04.007672 (+ 3819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:04.007684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.009978 (+ 2294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.009985 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:04.010248 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.010276 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 18:57:04.010349 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 18:57:04.010527 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1312,"mutex_wait_us":194,"spinlock_wait_cycles":58624,"thread_start_us":1051,"threads_started":1}
I20260809 18:57:04.011518 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:03.998890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43579 (local address 127.16.188.193:52741)
0809 18:57:04.000448 (+ 1558us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:04.000469 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:04.000661 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:04.001002 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:04.001007 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:04.001078 (+ 71us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:04.002116 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:04.002137 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.003836 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.003842 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:04.007668 (+ 3826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:04.007684 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.009872 (+ 2188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.009880 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:04.010127 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.010238 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 18:57:04.010338 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 18:57:04.010526 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1387,"mutex_wait_us":206,"spinlock_wait_cycles":1280,"thread_start_us":1021,"threads_started":1}
I20260809 18:57:04.012662 28179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01697cfc7b8c48d3bc18705c4fc729f3" candidate_uuid: "34bf4f29eab445369fca62c74983c34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880fce2d9251422f815f9a329a618a61" is_pre_election: true
I20260809 18:57:04.012622 28403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01697cfc7b8c48d3bc18705c4fc729f3" candidate_uuid: "34bf4f29eab445369fca62c74983c34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4212fc9479d44bc6a7369bd43623e133" is_pre_election: true
I20260809 18:57:04.013347 28403 raft_consensus.cc:2454] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bf4f29eab445369fca62c74983c34f in term 0.
I20260809 18:57:04.013309 28179 raft_consensus.cc:2454] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bf4f29eab445369fca62c74983c34f in term 0.
I20260809 18:57:04.014029 27837 leader_election.cc:302] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 34bf4f29eab445369fca62c74983c34f, 4212fc9479d44bc6a7369bd43623e133, 880fce2d9251422f815f9a329a618a61; no voters:
I20260809 18:57:04.014555 28533 raft_consensus.cc:2781] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:04.014820 28533 raft_consensus.cc:482] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:04.014992 28533 raft_consensus.cc:3037] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:04.018165 28533 raft_consensus.cc:504] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:04.018767 28533 leader_election.cc:288] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [CANDIDATE]: Term 1 election: Requested vote from peers 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579), 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977)
I20260809 18:57:04.019146 28403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01697cfc7b8c48d3bc18705c4fc729f3" candidate_uuid: "34bf4f29eab445369fca62c74983c34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4212fc9479d44bc6a7369bd43623e133"
W20260809 18:57:04.019338 28474 tablet.cc:2369] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:57:04.019407 28403 raft_consensus.cc:3037] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:04.019433 28179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01697cfc7b8c48d3bc18705c4fc729f3" candidate_uuid: "34bf4f29eab445369fca62c74983c34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880fce2d9251422f815f9a329a618a61"
I20260809 18:57:04.019677 28179 raft_consensus.cc:3037] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:04.023403 28179 raft_consensus.cc:2454] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bf4f29eab445369fca62c74983c34f in term 1.
I20260809 18:57:04.023562 28403 raft_consensus.cc:2454] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bf4f29eab445369fca62c74983c34f in term 1.
I20260809 18:57:04.023820 27836 leader_election.cc:302] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bf4f29eab445369fca62c74983c34f, 880fce2d9251422f815f9a329a618a61; no voters:
I20260809 18:57:04.024263 28533 raft_consensus.cc:2781] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:04.024883 28533 raft_consensus.cc:686] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 1 LEADER]: Becoming Leader. State: Replica: 34bf4f29eab445369fca62c74983c34f, State: Running, Role: LEADER
I20260809 18:57:04.025408 28533 consensus_queue.cc:237] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } }
I20260809 18:57:04.029582 26505 catalog_manager.cc:5495] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bf4f29eab445369fca62c74983c34f (127.16.188.193). New cstate: current_term: 1 leader_uuid: "34bf4f29eab445369fca62c74983c34f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:04.061236 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:04.055052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38324 (local address 127.16.188.193:37189)
0809 18:57:04.055263 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:04.055269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:04.055289 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:57:04.055391 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:04.055396 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:04.055490 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:04.055633 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:04.056080 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.057313 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.058944 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.059359 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.059471 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.060049 (+ 578us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:04.060611 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:04.060740 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:04.060841 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 18:57:04.060920 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:57:04.070570 28179 raft_consensus.cc:1261] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 1 FOLLOWER]: Refusing update from remote peer 34bf4f29eab445369fca62c74983c34f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:04.070634 28403 raft_consensus.cc:1261] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 1 FOLLOWER]: Refusing update from remote peer 34bf4f29eab445369fca62c74983c34f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:04.071648 28538 consensus_queue.cc:1035] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:04.072008 28533 consensus_queue.cc:1035] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [LEADER]: Connected to new peer: Peer: permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 18:57:04.086990 28026 tablet.cc:2369] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:57:04.090667 28541 mvcc.cc:205] Tried to move back new op lower bound from 7316692271382523904 to 7316692271211630592. Current Snapshot: MvccSnapshot[applied={T|T < 7316692271382523904}]
I20260809 18:57:04.114459 26505 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:04.114742 26505 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:04.122822 26505 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 468a04419f064f3b8a267c0cd9990914: Sending DeleteTablet for 3 replicas of tablet 01697cfc7b8c48d3bc18705c4fc729f3
I20260809 18:57:04.123946 27915 tablet_service.cc:1514] Processing DeleteTablet for tablet 01697cfc7b8c48d3bc18705c4fc729f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:04 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:38308
I20260809 18:57:04.124727 28367 tablet_service.cc:1514] Processing DeleteTablet for tablet 01697cfc7b8c48d3bc18705c4fc729f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:04 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:58158
I20260809 18:57:04.127439 28143 tablet_service.cc:1514] Processing DeleteTablet for tablet 01697cfc7b8c48d3bc18705c4fc729f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:04 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:41336
I20260809 18:57:04.128592 28562 tablet_replica.cc:330] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: stopping tablet replica
I20260809 18:57:04.130442 28561 tablet_replica.cc:330] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: stopping tablet replica
I20260809 18:57:04.131492 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 26458
I20260809 18:57:04.131935 28564 tablet_replica.cc:330] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: stopping tablet replica
I20260809 18:57:04.132433 28564 raft_consensus.cc:2229] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:04.132766 26558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:04.133285 28564 raft_consensus.cc:2258] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:04.133673 28562 raft_consensus.cc:2229] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:04.132488 28561 raft_consensus.cc:2229] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:04.134704 28561 raft_consensus.cc:2258] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:04.135643 28564 ts_tablet_manager.cc:1905] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:04.136319 28562 raft_consensus.cc:2258] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:04.145195 28564 ts_tablet_manager.cc:1918] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:04.145483 28564 log.cc:1196] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/01697cfc7b8c48d3bc18705c4fc729f3
I20260809 18:57:04.146365 28564 ts_tablet_manager.cc:1939] T 01697cfc7b8c48d3bc18705c4fc729f3 P 880fce2d9251422f815f9a329a618a61: Deleting consensus metadata
I20260809 18:57:04.155823 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:04.127050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.16.188.253:45709)
0809 18:57:04.128153 (+ 1103us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:04.128159 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:04.130340 (+ 2181us) server_negotiation.cc:407] Connection header received
0809 18:57:04.130642 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:04.130647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:04.130726 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:04.130791 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:04.134589 (+ 3798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.136130 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.138868 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.139792 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.139898 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.145325 (+ 5427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:04.145333 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:04.145339 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:04.145385 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:04.150839 (+ 5454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.151889 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.151896 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.151900 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.152138 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.152769 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.152775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.152778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.153242 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:04.153545 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:04.154985 (+ 1440us) server_negotiation.cc:299] Negotiation successful
0809 18:57:04.155224 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":972}
I20260809 18:57:04.162173 28561 ts_tablet_manager.cc:1905] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:04.165582 28562 ts_tablet_manager.cc:1905] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:04.180203 28481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:04.130324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47778 (local address 127.16.188.252:41941)
0809 18:57:04.130492 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:04.130498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:04.158402 (+ 27904us) server_negotiation.cc:407] Connection header received
0809 18:57:04.158697 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:04.158703 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:04.158793 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:04.158865 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:04.161787 (+ 2922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.163475 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.166104 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.166976 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.167074 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.171205 (+ 4131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:04.171212 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:04.171218 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:04.171263 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:04.176444 (+ 5181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.177534 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.177540 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.177544 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.177709 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.178208 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.178213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.178217 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.178619 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:04.178838 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:04.179456 (+ 618us) server_negotiation.cc:299] Negotiation successful
0809 18:57:04.179700 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 18:57:04.186378 28562 ts_tablet_manager.cc:1918] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:04.186638 28562 log.cc:1196] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/01697cfc7b8c48d3bc18705c4fc729f3
I20260809 18:57:04.187296 28562 ts_tablet_manager.cc:1939] T 01697cfc7b8c48d3bc18705c4fc729f3 P 4212fc9479d44bc6a7369bd43623e133: Deleting consensus metadata
I20260809 18:57:04.189980 28561 ts_tablet_manager.cc:1918] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:04.190160 28561 log.cc:1196] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/01697cfc7b8c48d3bc18705c4fc729f3
I20260809 18:57:04.190722 28561 ts_tablet_manager.cc:1939] T 01697cfc7b8c48d3bc18705c4fc729f3 P 34bf4f29eab445369fca62c74983c34f: Deleting consensus metadata
I20260809 18:57:04.299911 26484 catalog_manager.cc:4841] TS 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977): tablet 01697cfc7b8c48d3bc18705c4fc729f3 (table test-table [id=0c9a95f5b78f44808b0d5825c99844a8]) successfully deleted
I20260809 18:57:04.300289 26488 catalog_manager.cc:4841] TS 34bf4f29eab445369fca62c74983c34f (127.16.188.193:37189): tablet 01697cfc7b8c48d3bc18705c4fc729f3 (table test-table [id=0c9a95f5b78f44808b0d5825c99844a8]) successfully deleted
I20260809 18:57:04.300513 26488 catalog_manager.cc:4841] TS 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579): tablet 01697cfc7b8c48d3bc18705c4fc729f3 (table test-table [id=0c9a95f5b78f44808b0d5825c99844a8]) successfully deleted
I20260809 18:57:04.300665 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 26458
I20260809 18:57:04.371423 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:04.342633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53620 (local address 127.16.188.253:45709)
0809 18:57:04.342920 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:04.342927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:04.353578 (+ 10651us) server_negotiation.cc:407] Connection header received
0809 18:57:04.353997 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:04.354004 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:04.354094 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:04.354205 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:04.356701 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.357908 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.359951 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.360700 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.360789 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.364551 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:04.364558 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:04.364563 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:04.364612 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:04.368254 (+ 3642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.369039 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.369045 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.369049 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.369224 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.369638 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.369643 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.369646 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.369999 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:04.370237 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:04.370789 (+ 552us) server_negotiation.cc:299] Negotiation successful
0809 18:57:04.371067 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260809 18:57:04.373450 28481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:04.342221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47786 (local address 127.16.188.252:41941)
0809 18:57:04.342466 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:04.342473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:04.354742 (+ 12269us) server_negotiation.cc:407] Connection header received
0809 18:57:04.355077 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:04.355083 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:04.355174 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:04.355253 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:04.357704 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.358843 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.360938 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:04.362068 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:04.362181 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:04.366224 (+ 4043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:04.366231 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:04.366236 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:04.366280 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:04.369697 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.370615 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.370621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.370625 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.370782 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:04.371285 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:04.371291 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:04.371294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:04.371688 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:04.371929 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:04.372719 (+ 790us) server_negotiation.cc:299] Negotiation successful
0809 18:57:04.372940 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260809 18:57:05.107967 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.107214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.193:48375)
0809 18:57:05.107634 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.107762 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":203,"threads_started":1}
W20260809 18:57:05.108734 28012 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:33951 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
I20260809 18:57:05.110209 28582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.108521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.195:36857)
0809 18:57:05.109037 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.109204 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":290,"threads_started":1}
W20260809 18:57:05.110580 28472 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:33951 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
I20260809 18:57:05.111379 28583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.109909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.194:49245)
0809 18:57:05.111031 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.111170 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1025,"thread_start_us":927,"threads_started":1}
W20260809 18:57:05.111728 28240 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:33951 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
I20260809 18:57:05.622150 28585 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 468a04419f064f3b8a267c0cd9990914)
I20260809 18:57:05.622372 28585 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } }
I20260809 18:57:05.623207 28585 leader_election.cc:288] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 468a04419f064f3b8a267c0cd9990914 (127.16.188.254:33951), 7dffe902135142a1bed30839a14379b0 (127.16.188.253:45709)
I20260809 18:57:05.625012 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.623508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36058)
0809 18:57:05.624443 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.624732 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":788,"thread_start_us":623,"threads_started":1}
I20260809 18:57:05.625036 28597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 468a04419f064f3b8a267c0cd9990914)
W20260809 18:57:05.625363 27703 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
I20260809 18:57:05.625386 28597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } }
I20260809 18:57:05.626830 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.626509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36074)
0809 18:57:05.626645 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.626715 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 18:57:05.627031 27703 leader_election.cc:334] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 468a04419f064f3b8a267c0cd9990914 (127.16.188.254:33951): Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
I20260809 18:57:05.627799 28597 leader_election.cc:288] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 468a04419f064f3b8a267c0cd9990914 (127.16.188.254:33951), 72dc4841ff3c4eaa93623a6557647d38 (127.16.188.252:41941)
I20260809 18:57:05.628196 28599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.627123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36076)
0809 18:57:05.627641 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.627868 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":271,"threads_started":1}
W20260809 18:57:05.628500 27401 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
I20260809 18:57:05.632120 28594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.623625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53624 (local address 127.16.188.253:45709)
0809 18:57:05.624265 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.624272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.624807 (+ 535us) server_negotiation.cc:407] Connection header received
0809 18:57:05.625158 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.625163 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.625263 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.625384 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.626022 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.627159 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.629457 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.630820 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.630947 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.631025 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.631563 (+ 538us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.631710 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":276,"threads_started":1}
I20260809 18:57:05.633023 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.623638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:45709 (local address 127.0.0.1:53624)
0809 18:57:05.624691 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.624709 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.624946 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.625413 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.625418 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.625452 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.625799 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.625813 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.627300 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.627304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.629258 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.629285 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.631170 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.631176 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.631380 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.631415 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.632513 (+ 1098us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.632666 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"thread_start_us":796,"threads_started":1}
I20260809 18:57:05.633931 27436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "72dc4841ff3c4eaa93623a6557647d38" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7dffe902135142a1bed30839a14379b0" is_pre_election: true
I20260809 18:57:05.634284 27436 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72dc4841ff3c4eaa93623a6557647d38 in term 1.
I20260809 18:57:05.634824 27700 leader_election.cc:302] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72dc4841ff3c4eaa93623a6557647d38, 7dffe902135142a1bed30839a14379b0; no voters: 468a04419f064f3b8a267c0cd9990914
I20260809 18:57:05.635464 28585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 18:57:05.635604 28585 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 468a04419f064f3b8a267c0cd9990914)
I20260809 18:57:05.635725 28585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:57:05.636265 28599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.635875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36090)
0809 18:57:05.636039 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.636130 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 18:57:05.636775 27401 leader_election.cc:334] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 468a04419f064f3b8a267c0cd9990914 (127.16.188.254:33951): Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
I20260809 18:57:05.638903 28585 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } }
I20260809 18:57:05.639721 28585 leader_election.cc:288] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [CANDIDATE]: Term 2 election: Requested vote from peers 468a04419f064f3b8a267c0cd9990914 (127.16.188.254:33951), 7dffe902135142a1bed30839a14379b0 (127.16.188.253:45709)
I20260809 18:57:05.640166 27436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "72dc4841ff3c4eaa93623a6557647d38" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7dffe902135142a1bed30839a14379b0"
I20260809 18:57:05.640399 27436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:57:05.640532 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.640088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36094)
0809 18:57:05.640295 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.640379 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 18:57:05.641498 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.641166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36106)
0809 18:57:05.641282 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.641366 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 18:57:05.641702 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.628061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41941 (local address 127.0.0.1:47792)
0809 18:57:05.634180 (+ 6119us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.634197 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.634391 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.634975 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.634979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.635005 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.635308 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.635320 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.636989 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.636994 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.639001 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.639016 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.640973 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.640979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.641206 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.641241 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.641341 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.641444 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5987,"thread_start_us":5882,"threads_started":1}
W20260809 18:57:05.641721 27703 leader_election.cc:334] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 468a04419f064f3b8a267c0cd9990914 (127.16.188.254:33951): Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
I20260809 18:57:05.642217 28603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.628319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47792 (local address 127.16.188.252:41941)
0809 18:57:05.633775 (+ 5456us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.633781 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.634286 (+ 505us) server_negotiation.cc:407] Connection header received
0809 18:57:05.634557 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.634563 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.634636 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.634704 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.635504 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.636821 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.639172 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.640573 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.640773 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.640843 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.641879 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.641990 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5318,"thread_start_us":6270,"threads_started":1}
I20260809 18:57:05.642707 27735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7dffe902135142a1bed30839a14379b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "72dc4841ff3c4eaa93623a6557647d38" is_pre_election: true
I20260809 18:57:05.643095 27735 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7dffe902135142a1bed30839a14379b0 in current term 2: Already voted for candidate 72dc4841ff3c4eaa93623a6557647d38 in this term.
I20260809 18:57:05.643281 27436 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72dc4841ff3c4eaa93623a6557647d38 in term 2.
I20260809 18:57:05.643608 27700 leader_election.cc:302] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72dc4841ff3c4eaa93623a6557647d38, 7dffe902135142a1bed30839a14379b0; no voters: 468a04419f064f3b8a267c0cd9990914
I20260809 18:57:05.643663 27399 leader_election.cc:302] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7dffe902135142a1bed30839a14379b0; no voters: 468a04419f064f3b8a267c0cd9990914, 72dc4841ff3c4eaa93623a6557647d38
I20260809 18:57:05.643955 28585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:57:05.643982 28597 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:57:05.644372 28585 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [term 2 LEADER]: Becoming Leader. State: Replica: 72dc4841ff3c4eaa93623a6557647d38, State: Running, Role: LEADER
I20260809 18:57:05.644728 28585 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } }
I20260809 18:57:05.646482 28606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72dc4841ff3c4eaa93623a6557647d38. Latest consensus state: current_term: 2 leader_uuid: "72dc4841ff3c4eaa93623a6557647d38" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:05.646908 28606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:05.647502 28608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:05.651320 28608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:05.652099 28608 catalog_manager.cc:1259] Loaded cluster ID: bf6bff7a61674e86894e549cfae3bbe5
I20260809 18:57:05.652176 28608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:05.653304 28608 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:05.654062 28608 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Loaded TSK: 0
I20260809 18:57:05.654910 28608 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:57:05.699141 27720 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:05.706130 27720 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:05.710199 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.709838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36120)
0809 18:57:05.709980 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.710056 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 18:57:05.710419 27436 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [term 2 FOLLOWER]: Refusing update from remote peer 72dc4841ff3c4eaa93623a6557647d38: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 18:57:05.711167 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.710777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36130)
0809 18:57:05.710953 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.711025 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 18:57:05.711228 28606 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 18:57:05.711547 27703 consensus_peers.cc:487] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 -> Peer 468a04419f064f3b8a267c0cd9990914 (127.16.188.254:33951): Couldn't send request to peer 468a04419f064f3b8a267c0cd9990914. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 18:57:05.713932 28597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72dc4841ff3c4eaa93623a6557647d38. Latest consensus state: current_term: 2 leader_uuid: "72dc4841ff3c4eaa93623a6557647d38" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:05.714172 28597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:57:05.715876 28585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "72dc4841ff3c4eaa93623a6557647d38" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:05.716209 28585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:05.716410 28611 mvcc.cc:205] Tried to move back new op lower bound from 7316692278102941696 to 7316692277844197376. Current Snapshot: MvccSnapshot[applied={T|T < 7316692278102941696}]
I20260809 18:57:05.716351 28597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "72dc4841ff3c4eaa93623a6557647d38" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "468a04419f064f3b8a267c0cd9990914" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33951 } } peers { permanent_uuid: "7dffe902135142a1bed30839a14379b0" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 45709 } attrs { promote: false } } peers { permanent_uuid: "72dc4841ff3c4eaa93623a6557647d38" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41941 } attrs { promote: false } } }
I20260809 18:57:05.716648 28597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dffe902135142a1bed30839a14379b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:57:05.731557 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.724253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:41977 (local address 127.0.0.1:41340)
0809 18:57:05.724440 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.724459 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.724571 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.725186 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.725191 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.725218 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.725409 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.725420 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.727060 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.727067 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.729041 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.729057 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.730759 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.730767 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.730998 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.731040 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.731119 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.731259 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 18:57:05.733191 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.724378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41340 (local address 127.16.188.194:41977)
0809 18:57:05.724824 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.724829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.724849 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:57:05.724919 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.724924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.724992 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.725561 (+ 569us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.725727 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.726884 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.729254 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.730568 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.732564 (+ 1996us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.732658 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.732711 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.732861 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":224,"threads_started":1}
I20260809 18:57:05.734040 28143 tablet_service.cc:1467] Processing CreateTablet for tablet c3cef7b89a5a4496bd389b169c16bdd7 (DEFAULT_TABLE table=test-table [id=dd0c103aaacc4dd6b35788a46f60a552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.734540 28143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3cef7b89a5a4496bd389b169c16bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.739502 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.725346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38336 (local address 127.16.188.193:37189)
0809 18:57:05.725782 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.725788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.732026 (+ 6238us) server_negotiation.cc:407] Connection header received
0809 18:57:05.732126 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.732132 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.732214 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.732314 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.732763 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.733893 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.737312 (+ 3419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.738491 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.738634 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.738702 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.739069 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.739203 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":388,"threads_started":1}
I20260809 18:57:05.739542 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.725589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38336)
0809 18:57:05.731773 (+ 6184us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.731790 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.731910 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.732353 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.732360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.732388 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.732587 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.732597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.734359 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.734366 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.736279 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.736294 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.738647 (+ 2353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.738653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.738886 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.738935 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.739038 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.739160 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6096,"thread_start_us":12084,"threads_started":1}
I20260809 18:57:05.740362 27915 tablet_service.cc:1467] Processing CreateTablet for tablet c3cef7b89a5a4496bd389b169c16bdd7 (DEFAULT_TABLE table=test-table [id=dd0c103aaacc4dd6b35788a46f60a552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.740815 27915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3cef7b89a5a4496bd389b169c16bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.740972 28622 tablet_bootstrap.cc:492] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: Bootstrap starting.
I20260809 18:57:05.743341 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.724891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43579 (local address 127.0.0.1:58164)
0809 18:57:05.725017 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.725040 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:05.725175 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:05.737860 (+ 12685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:05.737865 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:05.737891 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:05.738157 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.738167 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.739643 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.739649 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.741175 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:05.741189 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.742679 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.742685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:05.742871 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.742904 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 18:57:05.742970 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 18:57:05.743098 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:57:05.743654 28622 tablet_bootstrap.cc:654] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.744223 28619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.725001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58164 (local address 127.16.188.195:43579)
0809 18:57:05.737438 (+ 12437us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.737445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.737463 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:57:05.737529 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.737534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.737613 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.738297 (+ 684us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:05.738531 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.739440 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.741393 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.742451 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.743654 (+ 1203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.743728 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.743794 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.743922 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12322,"thread_start_us":12696,"threads_started":1}
I20260809 18:57:05.745131 28367 tablet_service.cc:1467] Processing CreateTablet for tablet c3cef7b89a5a4496bd389b169c16bdd7 (DEFAULT_TABLE table=test-table [id=dd0c103aaacc4dd6b35788a46f60a552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:05.745544 28367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3cef7b89a5a4496bd389b169c16bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:05.747092 28625 tablet_bootstrap.cc:492] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f: Bootstrap starting.
I20260809 18:57:05.748399 28625 tablet_bootstrap.cc:654] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.750094 28625 tablet_bootstrap.cc:492] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f: No bootstrap required, opened a new log
I20260809 18:57:05.750403 28625 ts_tablet_manager.cc:1397] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260809 18:57:05.751158 28632 tablet_bootstrap.cc:492] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: Bootstrap starting.
I20260809 18:57:05.751837 28625 raft_consensus.cc:348] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.752070 28625 raft_consensus.cc:374] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.752194 28625 raft_consensus.cc:729] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bf4f29eab445369fca62c74983c34f, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.752475 28622 tablet_bootstrap.cc:492] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: No bootstrap required, opened a new log
I20260809 18:57:05.752457 28625 consensus_queue.cc:260] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.752626 28622 ts_tablet_manager.cc:1397] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260809 18:57:05.752914 28632 tablet_bootstrap.cc:654] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:05.753389 28622 raft_consensus.cc:348] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.753633 28622 raft_consensus.cc:374] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.753738 28622 raft_consensus.cc:729] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880fce2d9251422f815f9a329a618a61, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.753961 28622 consensus_queue.cc:260] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.754719 28622 ts_tablet_manager.cc:1428] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:57:05.758805 28239 heartbeater.cc:503] Master 127.16.188.252:41941 was elected leader, sending a full tablet report...
I20260809 18:57:05.761384 28625 ts_tablet_manager.cc:1428] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260809 18:57:05.763866 28011 heartbeater.cc:503] Master 127.16.188.252:41941 was elected leader, sending a full tablet report...
I20260809 18:57:05.766990 28639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.755247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.194:33087)
0809 18:57:05.766551 (+ 11304us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.766724 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11159,"thread_start_us":6356,"threads_started":1}
I20260809 18:57:05.769107 28640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.767599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.194:47349)
0809 18:57:05.768698 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.768848 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":975,"thread_start_us":834,"threads_started":1}
I20260809 18:57:05.769594 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.753570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.193:44073)
0809 18:57:05.769002 (+ 15432us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.769154 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15319,"thread_start_us":15173,"threads_started":1}
I20260809 18:57:05.770944 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.770559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.193:38365)
0809 18:57:05.770724 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.770812 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 18:57:05.771880 28632 tablet_bootstrap.cc:492] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: No bootstrap required, opened a new log
I20260809 18:57:05.772012 28632 ts_tablet_manager.cc:1397] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.005s
I20260809 18:57:05.772645 28632 raft_consensus.cc:348] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.772846 28632 raft_consensus.cc:374] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:05.772938 28632 raft_consensus.cc:729] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4212fc9479d44bc6a7369bd43623e133, State: Initialized, Role: FOLLOWER
I20260809 18:57:05.773200 28632 consensus_queue.cc:260] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.773931 28632 ts_tablet_manager.cc:1428] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:57:05.775812 28471 heartbeater.cc:503] Master 127.16.188.252:41941 was elected leader, sending a full tablet report...
I20260809 18:57:05.777009 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.774166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.195:53103)
0809 18:57:05.776681 (+ 2515us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.776809 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2391,"thread_start_us":2268,"threads_started":1}
I20260809 18:57:05.777971 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.777644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.195:40415)
0809 18:57:05.777772 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.777849 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:57:05.801690 28633 raft_consensus.cc:482] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:05.801875 28633 raft_consensus.cc:504] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.802472 28633 leader_election.cc:288] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977), 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579)
I20260809 18:57:05.802928 28403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cef7b89a5a4496bd389b169c16bdd7" candidate_uuid: "34bf4f29eab445369fca62c74983c34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4212fc9479d44bc6a7369bd43623e133" is_pre_election: true
I20260809 18:57:05.802981 28178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cef7b89a5a4496bd389b169c16bdd7" candidate_uuid: "34bf4f29eab445369fca62c74983c34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880fce2d9251422f815f9a329a618a61" is_pre_election: true
I20260809 18:57:05.803134 28403 raft_consensus.cc:2454] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bf4f29eab445369fca62c74983c34f in term 0.
I20260809 18:57:05.803305 28178 raft_consensus.cc:2454] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bf4f29eab445369fca62c74983c34f in term 0.
I20260809 18:57:05.803510 27837 leader_election.cc:302] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bf4f29eab445369fca62c74983c34f, 4212fc9479d44bc6a7369bd43623e133; no voters:
I20260809 18:57:05.803768 28633 raft_consensus.cc:2781] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:05.803881 28633 raft_consensus.cc:482] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:05.803953 28633 raft_consensus.cc:3037] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.806308 28633 raft_consensus.cc:504] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.806885 28633 leader_election.cc:288] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [CANDIDATE]: Term 1 election: Requested vote from peers 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977), 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579)
I20260809 18:57:05.807278 28403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cef7b89a5a4496bd389b169c16bdd7" candidate_uuid: "34bf4f29eab445369fca62c74983c34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4212fc9479d44bc6a7369bd43623e133"
I20260809 18:57:05.807308 28178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cef7b89a5a4496bd389b169c16bdd7" candidate_uuid: "34bf4f29eab445369fca62c74983c34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880fce2d9251422f815f9a329a618a61"
I20260809 18:57:05.807442 28403 raft_consensus.cc:3037] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.807473 28178 raft_consensus.cc:3037] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:05.809718 28403 raft_consensus.cc:2454] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bf4f29eab445369fca62c74983c34f in term 1.
I20260809 18:57:05.809912 28178 raft_consensus.cc:2454] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bf4f29eab445369fca62c74983c34f in term 1.
I20260809 18:57:05.810067 27837 leader_election.cc:302] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bf4f29eab445369fca62c74983c34f, 4212fc9479d44bc6a7369bd43623e133; no voters:
I20260809 18:57:05.810348 28633 raft_consensus.cc:2781] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:05.810797 28633 raft_consensus.cc:686] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 1 LEADER]: Becoming Leader. State: Replica: 34bf4f29eab445369fca62c74983c34f, State: Running, Role: LEADER
I20260809 18:57:05.811169 28633 consensus_queue.cc:237] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } }
I20260809 18:57:05.811785 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.811393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.193:34581)
0809 18:57:05.811545 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.811637 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 18:57:05.813823 27720 catalog_manager.cc:5495] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bf4f29eab445369fca62c74983c34f (127.16.188.193). New cstate: current_term: 1 leader_uuid: "34bf4f29eab445369fca62c74983c34f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bf4f29eab445369fca62c74983c34f" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 37189 } health_report { overall_health: HEALTHY } } }
I20260809 18:57:05.838521 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.834020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38350 (local address 127.16.188.193:37189)
0809 18:57:05.834225 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.834229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.834248 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:57:05.834326 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.834329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.834392 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.834471 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:05.834767 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.835480 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.836746 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.837262 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.837366 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.837759 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:05.837895 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:05.837983 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.838164 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.838242 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:57:05.843241 28178 raft_consensus.cc:1261] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 1 FOLLOWER]: Refusing update from remote peer 34bf4f29eab445369fca62c74983c34f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:05.843456 28403 raft_consensus.cc:1261] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 1 FOLLOWER]: Refusing update from remote peer 34bf4f29eab445369fca62c74983c34f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:05.843922 28644 consensus_queue.cc:1035] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [LEADER]: Connected to new peer: Peer: permanent_uuid: "880fce2d9251422f815f9a329a618a61" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:05.844259 28633 consensus_queue.cc:1035] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4212fc9479d44bc6a7369bd43623e133" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:05.846139 28640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.845617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.194:54583)
0809 18:57:05.845863 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.845964 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260809 18:57:05.847419 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.846922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.195:41057)
0809 18:57:05.847151 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.847263 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260809 18:57:05.853705 28653 mvcc.cc:205] Tried to move back new op lower bound from 7316692278647676928 to 7316692278525075456. Current Snapshot: MvccSnapshot[applied={T|T < 7316692278647676928}]
I20260809 18:57:05.855669 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.854841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.195:41447)
0809 18:57:05.855430 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.855512 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488}
I20260809 18:57:05.857527 28640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.856268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.194:44207)
0809 18:57:05.857240 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.857369 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":868}
I20260809 18:57:05.860350 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.859947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.16.188.193:54191)
0809 18:57:05.860109 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:05.860204 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 18:57:05.863644 27720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:05.863857 27720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:05.868654 27720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72dc4841ff3c4eaa93623a6557647d38: Sending DeleteTablet for 3 replicas of tablet c3cef7b89a5a4496bd389b169c16bdd7
I20260809 18:57:05.869695 28367 tablet_service.cc:1514] Processing DeleteTablet for tablet c3cef7b89a5a4496bd389b169c16bdd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:05 UTC) from {username='oryx', principal='oryx/127.16.188.252@KRBTEST.COM'} at 127.0.0.1:58164
I20260809 18:57:05.869765 27915 tablet_service.cc:1514] Processing DeleteTablet for tablet c3cef7b89a5a4496bd389b169c16bdd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:05 UTC) from {username='oryx', principal='oryx/127.16.188.252@KRBTEST.COM'} at 127.0.0.1:38336
I20260809 18:57:05.869774 28143 tablet_service.cc:1514] Processing DeleteTablet for tablet c3cef7b89a5a4496bd389b169c16bdd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:05 UTC) from {username='oryx', principal='oryx/127.16.188.252@KRBTEST.COM'} at 127.0.0.1:41340
I20260809 18:57:05.870303 28665 tablet_replica.cc:330] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: stopping tablet replica
I20260809 18:57:05.870524 28665 raft_consensus.cc:2229] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:05.870878 28665 raft_consensus.cc:2258] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:05.871464 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 27686
I20260809 18:57:05.872315 28665 ts_tablet_manager.cc:1905] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:05.880574 28665 ts_tablet_manager.cc:1918] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:05.880810 28665 log.cc:1196] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/c3cef7b89a5a4496bd389b169c16bdd7
I20260809 18:57:05.881705 28665 ts_tablet_manager.cc:1939] T c3cef7b89a5a4496bd389b169c16bdd7 P 4212fc9479d44bc6a7369bd43623e133: Deleting consensus metadata
I20260809 18:57:05.883132 27703 catalog_manager.cc:4841] TS 4212fc9479d44bc6a7369bd43623e133 (127.16.188.195:43579): tablet c3cef7b89a5a4496bd389b169c16bdd7 (table test-table [id=dd0c103aaacc4dd6b35788a46f60a552]) successfully deleted
I20260809 18:57:05.883560 28666 tablet_replica.cc:330] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: stopping tablet replica
I20260809 18:57:05.883759 28666 raft_consensus.cc:2229] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:05.884063 28666 raft_consensus.cc:2258] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:05.884780 28667 tablet_replica.cc:330] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f: stopping tablet replica
I20260809 18:57:05.884948 28667 raft_consensus.cc:2229] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:05.885324 28667 raft_consensus.cc:2258] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:05.885694 28666 ts_tablet_manager.cc:1905] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:05.886185 28667 ts_tablet_manager.cc:1905] T c3cef7b89a5a4496bd389b169c16bdd7 P 34bf4f29eab445369fca62c74983c34f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:05.889700 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:05.873213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38366 (local address 127.16.188.193:37189)
0809 18:57:05.873383 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:05.873390 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:05.873410 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:57:05.873652 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:05.873658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:05.873738 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:05.873840 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:05.875484 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.876752 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.878324 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:05.879043 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:05.879171 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:05.882272 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:05.882286 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:05.882312 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:05.882347 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:05.886393 (+ 4046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.887257 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.887266 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.887270 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.887452 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:05.887935 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:05.887940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:05.887944 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:05.888424 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:05.888705 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:05.889106 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 18:57:05.889321 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:57:05.890406 28002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:05.891505 28666 ts_tablet_manager.cc:1918] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:05.891638 28666 log.cc:1196] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/c3cef7b89a5a4496bd389b169c16bdd7
I20260809 18:57:05.892055 28666 ts_tablet_manager.cc:1939] T c3cef7b89a5a4496bd389b169c16bdd7 P 880fce2d9251422f815f9a329a618a61: Deleting consensus metadata
I20260809 18:57:05.893146 27700 catalog_manager.cc:4841] TS 880fce2d9251422f815f9a329a618a61 (127.16.188.194:41977): tablet c3cef7b89a5a4496bd389b169c16bdd7 (table test-table [id=dd0c103aaacc4dd6b35788a46f60a552]) successfully deleted
I20260809 18:57:06.007486 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 27686
I20260809 18:57:06.036206 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 28034
I20260809 18:57:06.036902 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.036458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38368)
0809 18:57:06.036646 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.036730 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 18:57:06.037215 27703 catalog_manager.cc:4584] TS 34bf4f29eab445369fca62c74983c34f (127.16.188.193:37189): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3cef7b89a5a4496bd389b169c16bdd7: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
I20260809 18:57:06.048578 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.036980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41346 (local address 127.16.188.194:41977)
0809 18:57:06.037194 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.037200 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.037223 (+ 23us) server_negotiation.cc:407] Connection header received
0809 18:57:06.037361 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.037366 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.037461 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.037573 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:06.038783 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.039483 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.040625 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.041038 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.041270 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.043441 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:06.043455 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:06.043472 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:06.043502 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:06.046011 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:06.046666 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:06.046674 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:06.046676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:06.046806 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:06.047181 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:06.047185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:06.047187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:06.047536 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:06.047840 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.048091 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.048322 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 18:57:06.049249 28230 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:06.089679 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.089167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38382)
0809 18:57:06.089396 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.089498 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 18:57:06.090667 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.090304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38396)
0809 18:57:06.090451 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.090537 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 18:57:06.091907 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.091528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36132)
0809 18:57:06.091672 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.091763 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 18:57:06.092829 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.092477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33951 (local address 127.0.0.1:36144)
0809 18:57:06.092602 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.092704 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 18:57:06.146777 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 28034
I20260809 18:57:06.160256 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.159718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38402)
0809 18:57:06.159926 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.160037 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 18:57:06.161342 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.160893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38406)
0809 18:57:06.161058 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.161199 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 18:57:06.169196 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 28266
I20260809 18:57:06.181277 28619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.169863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58170 (local address 127.16.188.195:43579)
0809 18:57:06.170032 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:06.170037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:06.170054 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:57:06.170179 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:06.170184 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:06.170246 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:06.170324 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:06.171554 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.172242 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.173606 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:06.174006 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:06.174096 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:06.176334 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:06.176347 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:06.176364 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:06.176393 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:06.179056 (+ 2663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:06.179644 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:06.179651 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:06.179653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:06.179781 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:06.180039 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:06.180042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:06.180044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:06.180367 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:06.180566 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:06.180815 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 18:57:06.180978 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:57:06.181859 28461 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:06.268998 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.268431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38418)
0809 18:57:06.268668 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.268787 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 18:57:06.270210 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.269786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38430)
0809 18:57:06.269940 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.270035 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 18:57:06.274397 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 28266
I20260809 18:57:06.301954 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 27206
I20260809 18:57:06.302995 27468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:06.420316 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 27206
I20260809 18:57:06.448822 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.448337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38440)
0809 18:57:06.448556 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.448650 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 18:57:06.449863 28591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:06.449493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:37189 (local address 127.0.0.1:38442)
0809 18:57:06.449655 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:06.449728 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:37189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 18:57:06.450609 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 27361
I20260809 18:57:06.451562 27772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:06.570932 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 27361
2026-08-09T18:57:06Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9842 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:06 dist-test-slave-266d krb5kdc[28683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:06 dist-test-slave-266d krb5kdc[28683](info): set up 2 sockets
Aug 09 18:57:06 dist-test-slave-266d krb5kdc[28683](info): commencing operation
krb5kdc: starting...
W20260809 18:57:07.787387 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:57:07 dist-test-slave-266d krb5kdc[28683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.254.keytab.
Entry for principal oryx/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.254.keytab.
I20260809 18:57:08.007655 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:36211
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.254.keytab
--principal=oryx/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:36211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:08.332093 28707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:08.332369 28707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:08.332505 28707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:08.339469 28707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:08.339572 28707 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:57:08.339640 28707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:08.339725 28707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:08.339797 28707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:08.339879 28707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:08.349466 28707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:36211
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.254.keytab
--principal=oryx/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:36211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:08.350628 28707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:08.351866 28707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:08.362937 28715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:08.362857 28716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:08.362902 28722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:08.363837 28707 server_base.cc:1034] running on GCE node
I20260809 18:57:08.364491 28707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:08.365842 28707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:08.367048 28707 hybrid_clock.cc:648] HybridClock initialized: now 1786301828366987 us; error 39 us; skew 500 ppm
I20260809 18:57:08.367358 28707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:08 dist-test-slave-266d krb5kdc[28683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301828, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:08.370270 28707 init.cc:377] Logged in from keytab as oryx/127.16.188.254@KRBTEST.COM (short username oryx)
I20260809 18:57:08.371600 28707 webserver.cc:460] Webserver started at http://127.16.188.254:36289/ using document root <none> and password file <none>
I20260809 18:57:08.372251 28707 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:08.372351 28707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:08.372653 28707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:08.375442 28707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "3c97c7d6ddd3487595e40716add6ceac"
format_stamp: "Formatted at 2026-08-09 18:57:08 on dist-test-slave-266d"
server_key: "b61c6275e47c6017ce6cb056745779e7"
server_key_iv: "6a39c08c4e549301fd0f623d45224644"
server_key_version: "encryptionkey@0"
I20260809 18:57:08.376232 28707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "3c97c7d6ddd3487595e40716add6ceac"
format_stamp: "Formatted at 2026-08-09 18:57:08 on dist-test-slave-266d"
server_key: "b61c6275e47c6017ce6cb056745779e7"
server_key_iv: "6a39c08c4e549301fd0f623d45224644"
server_key_version: "encryptionkey@0"
I20260809 18:57:08.380927 28707 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 18:57:08.384079 28733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:08.385257 28707 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:57:08.385411 28707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "3c97c7d6ddd3487595e40716add6ceac"
format_stamp: "Formatted at 2026-08-09 18:57:08 on dist-test-slave-266d"
server_key: "b61c6275e47c6017ce6cb056745779e7"
server_key_iv: "6a39c08c4e549301fd0f623d45224644"
server_key_version: "encryptionkey@0"
I20260809 18:57:08.385591 28707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:08.416702 28707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:08.420399 28707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:08.420621 28707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:08.440177 28707 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:36211
I20260809 18:57:08.440210 28834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:36211 every 8 connection(s)
I20260809 18:57:08.441500 28707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:08.445116 28835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:08.447108 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 28707
I20260809 18:57:08.447324 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:57:08.447950 17139 external_mini_cluster.cc:1428] Setting key 9c36485fce564a3de4469a7c5e7d53cd
I20260809 18:57:08.457485 28835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: Bootstrap starting.
I20260809 18:57:08.460826 28835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:08.461808 28835 log.cc:824] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: Log is configured to *not* fsync() on all Append() calls
Aug 09 18:57:08 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:08.464805 28835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: No bootstrap required, opened a new log
I20260809 18:57:08.471606 28840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:08.449825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55670 (local address 127.16.188.254:36211)
0809 18:57:08.450739 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:08.450755 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:08.450805 (+ 50us) server_negotiation.cc:407] Connection header received
0809 18:57:08.453132 (+ 2327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:08.453159 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:08.453623 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:08.454075 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:08.455317 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:08.457229 (+ 1912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:08.458412 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:08.459443 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:08.459617 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:08.463535 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:08.463546 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:08.463563 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:08.463606 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:08.467374 (+ 3768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:08.467973 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:08.467982 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:08.467994 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:08.468207 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:08.468517 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:08.468522 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:08.468525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:08.469253 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:08.469512 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:08.469866 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 18:57:08.470298 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":434,"threads_started":1}
I20260809 18:57:08.474282 28835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97c7d6ddd3487595e40716add6ceac" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36211 } }
I20260809 18:57:08.474591 28835 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:08.474663 28835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c97c7d6ddd3487595e40716add6ceac, State: Initialized, Role: FOLLOWER
I20260809 18:57:08.475101 28835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97c7d6ddd3487595e40716add6ceac" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36211 } }
I20260809 18:57:08.475302 28835 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:08.475399 28835 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:08.475517 28835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:08.477546 28835 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97c7d6ddd3487595e40716add6ceac" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36211 } }
I20260809 18:57:08.477980 28835 leader_election.cc:302] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c97c7d6ddd3487595e40716add6ceac; no voters:
I20260809 18:57:08.478441 28835 leader_election.cc:288] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:08.478574 28843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:08.479650 28843 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [term 1 LEADER]: Becoming Leader. State: Replica: 3c97c7d6ddd3487595e40716add6ceac, State: Running, Role: LEADER
I20260809 18:57:08.480099 28843 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97c7d6ddd3487595e40716add6ceac" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36211 } }
I20260809 18:57:08.480403 28835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:08.482595 28846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c97c7d6ddd3487595e40716add6ceac. Latest consensus state: current_term: 1 leader_uuid: "3c97c7d6ddd3487595e40716add6ceac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97c7d6ddd3487595e40716add6ceac" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36211 } } }
I20260809 18:57:08.483084 28846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:08.483031 28845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c97c7d6ddd3487595e40716add6ceac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97c7d6ddd3487595e40716add6ceac" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36211 } } }
I20260809 18:57:08.483389 28845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:08.485893 28859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:08.490677 28859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:08.499070 28859 catalog_manager.cc:1347] Generated new cluster ID: cd3132d6235b48a08ebc2ec1397a8844
I20260809 18:57:08.499162 28859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:08.508666 28859 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:08.509919 28859 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:08.518734 28859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: Generated new TSK 0
I20260809 18:57:08.519431 28859 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab.
Entry for principal oryx/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab.
I20260809 18:57:08.586527 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36211
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab
--principal=oryx/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:08.943462 28876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:08.943737 28876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:08.943840 28876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:08.950747 28876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:08.950843 28876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:08.950932 28876 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:57:08.951009 28876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:57:08.960173 28876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab
--principal=oryx/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:36211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:08.961337 28876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:08.962554 28876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:08.975090 28885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:08.975116 28888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:08.975330 28886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:08.975880 28876 server_base.cc:1034] running on GCE node
I20260809 18:57:08.976465 28876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:08.977355 28876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:08.978586 28876 hybrid_clock.cc:648] HybridClock initialized: now 1786301828978510 us; error 26 us; skew 500 ppm
I20260809 18:57:08.978849 28876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:08 dist-test-slave-266d krb5kdc[28683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301828, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:08.981791 28876 init.cc:377] Logged in from keytab as oryx/127.16.188.193@KRBTEST.COM (short username oryx)
I20260809 18:57:08.983107 28876 webserver.cc:460] Webserver started at http://127.16.188.193:34735/ using document root <none> and password file <none>
I20260809 18:57:08.983732 28876 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:08.983834 28876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:08.984133 28876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:08.986939 28876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "a33b3ec87e4c42bd97a8033d0db17e16"
format_stamp: "Formatted at 2026-08-09 18:57:08 on dist-test-slave-266d"
server_key: "7e86e5db4ab4246e1abb2a2bbc1c8e18"
server_key_iv: "9ddb1f6ef09d9eff34aa6ad2fe90f4b7"
server_key_version: "encryptionkey@0"
I20260809 18:57:08.987699 28876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "a33b3ec87e4c42bd97a8033d0db17e16"
format_stamp: "Formatted at 2026-08-09 18:57:08 on dist-test-slave-266d"
server_key: "7e86e5db4ab4246e1abb2a2bbc1c8e18"
server_key_iv: "9ddb1f6ef09d9eff34aa6ad2fe90f4b7"
server_key_version: "encryptionkey@0"
I20260809 18:57:08.992444 28876 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 18:57:08.995647 28897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:08.996814 28876 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:57:08.996966 28876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "a33b3ec87e4c42bd97a8033d0db17e16"
format_stamp: "Formatted at 2026-08-09 18:57:08 on dist-test-slave-266d"
server_key: "7e86e5db4ab4246e1abb2a2bbc1c8e18"
server_key_iv: "9ddb1f6ef09d9eff34aa6ad2fe90f4b7"
server_key_version: "encryptionkey@0"
I20260809 18:57:08.997191 28876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:09.009462 28876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:09.013033 28876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:09.013291 28876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:09.015844 28876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:09.015945 28876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:09.016101 28876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:09.016213 28876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 09 18:57:09 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301828, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:09.040277 28919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:09.016868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36211 (local address 127.16.188.193:47625)
0809 18:57:09.017642 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:09.017678 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:09.019616 (+ 1938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:09.020366 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:09.020377 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:09.021184 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:09.022196 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:09.022225 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.023598 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.023604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:09.026002 (+ 2398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:09.026022 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.026976 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.026986 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:09.027293 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:09.028105 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:09.028145 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:09.031209 (+ 3064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:09.034965 (+ 3756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:09.034975 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:09.034995 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:09.035677 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:09.036240 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:09.036245 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:09.036254 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:09.036538 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:09.037373 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:09.037382 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:09.037801 (+ 419us) client_negotiation.cc:769] Sending connection context
0809 18:57:09.038170 (+ 369us) client_negotiation.cc:240] Negotiation successful
0809 18:57:09.038734 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":351,"threads_started":1}
I20260809 18:57:09.041314 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:09.016204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:47625 (local address 127.16.188.254:36211)
0809 18:57:09.016721 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:09.016728 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:09.017794 (+ 1066us) server_negotiation.cc:407] Connection header received
0809 18:57:09.019877 (+ 2083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:09.019882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:09.019973 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:09.020084 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:09.022466 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.023434 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.026189 (+ 2755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.026697 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.026825 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:09.031440 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:09.031446 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:09.031449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:09.031485 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:09.034813 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:09.035866 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:09.035872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:09.035875 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:09.036073 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:09.036713 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:09.036719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:09.036722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:09.037116 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:09.037279 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:09.040782 (+ 3503us) server_negotiation.cc:299] Negotiation successful
0809 18:57:09.040964 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":261,"threads_started":1}
I20260809 18:57:09.062021 28876 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:42027
I20260809 18:57:09.062079 29111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:42027 every 8 connection(s)
I20260809 18:57:09.063292 28876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:09.064427 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:09.051248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:38325 (local address 127.16.188.254:36211)
0809 18:57:09.051403 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:09.051407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:09.052003 (+ 596us) server_negotiation.cc:407] Connection header received
0809 18:57:09.052178 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:09.052184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:09.052257 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:09.052346 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:09.053383 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.054361 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.055716 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.056169 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.056283 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:09.058537 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:09.058544 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:09.058548 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:09.058583 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:09.061660 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:09.062389 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:09.062395 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:09.062399 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:09.062545 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:09.062925 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:09.062930 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:09.062934 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:09.063223 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:09.063382 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:09.063814 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 18:57:09.064026 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:57:09.064574 29082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:09.051297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36211 (local address 127.16.188.193:38325)
0809 18:57:09.051901 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:09.051917 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:09.052059 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:09.052385 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:09.052390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:09.052878 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:09.053245 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:09.053255 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.054491 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.054502 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:09.055572 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:09.055584 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.056379 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.056385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:09.056541 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:09.057173 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:09.057196 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:09.058329 (+ 1133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:09.061787 (+ 3458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:09.061794 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:09.061798 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:09.062280 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:09.062666 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:09.062672 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:09.062676 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:09.062815 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:09.063348 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:09.063353 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:09.063549 (+ 196us) client_negotiation.cc:769] Sending connection context
0809 18:57:09.063688 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 18:57:09.064037 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":325,"threads_started":1}
I20260809 18:57:09.065557 29112 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36211
I20260809 18:57:09.066087 29112 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:09.067021 29112 heartbeater.cc:511] Master 127.16.188.254:36211 requested a full tablet report, sending...
I20260809 18:57:09.069224 28757 ts_manager.cc:194] Registered new tserver with Master: a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027)
I20260809 18:57:09.070192 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 28876
I20260809 18:57:09.070443 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:09.071163 28757 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:47625
I20260809 18:57:09.071297 17139 external_mini_cluster.cc:1428] Setting key 54accff1609e0e44309100019636a432
WARNING: no policy specified for oryx/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab.
Entry for principal oryx/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab.
I20260809 18:57:09.125666 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36211
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab
--principal=oryx/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:09.449990 29119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:09.450274 29119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:09.450414 29119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:09.457587 29119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:09.457700 29119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:09.457815 29119 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:57:09.457924 29119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:57:09.467458 29119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab
--principal=oryx/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:36211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:09.468637 29119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:09.470109 29119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:09.482730 29130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:09.482771 29134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:09.482690 29131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:09.483702 29119 server_base.cc:1034] running on GCE node
I20260809 18:57:09.484257 29119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:09.485162 29119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:09.486389 29119 hybrid_clock.cc:648] HybridClock initialized: now 1786301829486317 us; error 40 us; skew 500 ppm
I20260809 18:57:09.486732 29119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:09 dist-test-slave-266d krb5kdc[28683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301829, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:09.489835 29119 init.cc:377] Logged in from keytab as oryx/127.16.188.194@KRBTEST.COM (short username oryx)
I20260809 18:57:09.491228 29119 webserver.cc:460] Webserver started at http://127.16.188.194:39823/ using document root <none> and password file <none>
I20260809 18:57:09.491882 29119 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:09.491982 29119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:09.492290 29119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:09.495146 29119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "39ce79d38c4b43b6923b30094c2f37b4"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-266d"
server_key: "359dda3844e11b1a5c831730a1f0d1e7"
server_key_iv: "1db5a1b4fee924d031794412190c904f"
server_key_version: "encryptionkey@0"
I20260809 18:57:09.495941 29119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "39ce79d38c4b43b6923b30094c2f37b4"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-266d"
server_key: "359dda3844e11b1a5c831730a1f0d1e7"
server_key_iv: "1db5a1b4fee924d031794412190c904f"
server_key_version: "encryptionkey@0"
I20260809 18:57:09.500897 29119 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 18:57:09.504283 29146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:09.505532 29119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:09.505698 29119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "39ce79d38c4b43b6923b30094c2f37b4"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-266d"
server_key: "359dda3844e11b1a5c831730a1f0d1e7"
server_key_iv: "1db5a1b4fee924d031794412190c904f"
server_key_version: "encryptionkey@0"
I20260809 18:57:09.505890 29119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:09.520447 29119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:09.524219 29119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:09.524428 29119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:09.526930 29119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:09.527031 29119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:09.527184 29119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:09.527252 29119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:57:09 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301829, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:09.549129 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:09.527497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:45435 (local address 127.16.188.254:36211)
0809 18:57:09.527683 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:09.527689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:09.529132 (+ 1443us) server_negotiation.cc:407] Connection header received
0809 18:57:09.531203 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:09.531210 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:09.531298 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:09.531386 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:09.532965 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.533944 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.536834 (+ 2890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.537399 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.537529 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:09.541971 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:09.541978 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:09.541983 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:09.542029 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:09.545516 (+ 3487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:09.546424 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:09.546428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:09.546430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:09.546548 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:09.547101 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:09.547108 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:09.547111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:09.547486 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:09.547626 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:09.548509 (+ 883us) server_negotiation.cc:299] Negotiation successful
0809 18:57:09.548736 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 18:57:09.550714 29159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:09.528159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36211 (local address 127.16.188.194:45435)
0809 18:57:09.528963 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:09.529008 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:09.530920 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:09.531664 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:09.531676 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:09.532244 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:09.532782 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:09.532799 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.534107 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.534113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:09.536668 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:09.536688 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.537649 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.537661 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:09.537873 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:09.538502 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:09.538532 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:09.541690 (+ 3158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:09.545669 (+ 3979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:09.545682 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:09.545697 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:09.546247 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:09.546678 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:09.546687 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:09.546690 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:09.546979 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:09.547642 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:09.547649 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:09.548056 (+ 407us) client_negotiation.cc:769] Sending connection context
0809 18:57:09.548419 (+ 363us) client_negotiation.cc:240] Negotiation successful
0809 18:57:09.549004 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":360,"threads_started":1}
I20260809 18:57:09.564193 29119 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:35247
I20260809 18:57:09.564231 29323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:35247 every 8 connection(s)
I20260809 18:57:09.565649 29119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:09.568058 29324 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36211
I20260809 18:57:09.568372 29324 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:09.569232 29324 heartbeater.cc:511] Master 127.16.188.254:36211 requested a full tablet report, sending...
I20260809 18:57:09.569713 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 29119
I20260809 18:57:09.569896 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:09.570446 17139 external_mini_cluster.cc:1428] Setting key 1fb7f0126ecb313076a93d1a8bdafbcd
I20260809 18:57:09.570808 28757 ts_manager.cc:194] Registered new tserver with Master: 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247)
I20260809 18:57:09.571871 28757 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:45435
I20260809 18:57:09.578320 29308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:09.559997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36211 (local address 127.16.188.194:54439)
0809 18:57:09.565568 (+ 5571us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:09.565587 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:09.565734 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:09.566086 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:09.566090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:09.566737 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:09.567166 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:09.567181 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.568199 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.568205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:09.569744 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:09.569758 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.570795 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.570802 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:09.570968 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:09.571542 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:09.571564 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:09.572439 (+ 875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:09.575939 (+ 3500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:09.575943 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:09.575946 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:09.576325 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:09.576751 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:09.576755 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:09.576758 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:09.576891 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:09.577510 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:09.577514 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:09.577686 (+ 172us) client_negotiation.cc:769] Sending connection context
0809 18:57:09.577803 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 18:57:09.578013 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5419,"thread_start_us":5265,"threads_started":1}
I20260809 18:57:09.578393 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:09.560494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:54439 (local address 127.16.188.254:36211)
0809 18:57:09.560681 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:09.560687 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:09.565677 (+ 4990us) server_negotiation.cc:407] Connection header received
0809 18:57:09.565877 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:09.565882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:09.565965 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:09.566081 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:09.567318 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.568068 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.569941 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:09.570604 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:09.570733 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:09.572603 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:09.572609 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:09.572614 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:09.572647 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:09.575812 (+ 3165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:09.576430 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:09.576434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:09.576437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:09.576614 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:09.576990 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:09.576995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:09.576997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:09.577396 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:09.577532 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:09.577905 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 18:57:09.578111 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
WARNING: no policy specified for oryx/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab.
Entry for principal oryx/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab.
I20260809 18:57:09.622439 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36211
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab
--principal=oryx/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:09.954633 29330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:09.954910 29330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:09.955020 29330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:09.962306 29330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:09.962409 29330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:09.962532 29330 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:57:09.962635 29330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:57:09.972049 29330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab
--principal=oryx/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.188.254:36211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:09.973268 29330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:09.974561 29330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:09.988097 29337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:09.988078 29339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:09.989192 29335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:09.989398 29330 server_base.cc:1034] running on GCE node
I20260809 18:57:09.990257 29330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:09.991120 29330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:09.992357 29330 hybrid_clock.cc:648] HybridClock initialized: now 1786301829992288 us; error 34 us; skew 500 ppm
I20260809 18:57:09.992672 29330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:09 dist-test-slave-266d krb5kdc[28683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301829, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:09.995783 29330 init.cc:377] Logged in from keytab as oryx/127.16.188.195@KRBTEST.COM (short username oryx)
I20260809 18:57:09.997267 29330 webserver.cc:460] Webserver started at http://127.16.188.195:38621/ using document root <none> and password file <none>
I20260809 18:57:09.997928 29330 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:09.998037 29330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:09.998368 29330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:10.001343 29330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "7aeaef52f416409998e8dbed78e87a7a"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-266d"
server_key: "f1894704757285447f1e72cefe30ddc5"
server_key_iv: "ba4733eadaaaa6bef5620ba05fb2efa1"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.002207 29330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "7aeaef52f416409998e8dbed78e87a7a"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-266d"
server_key: "f1894704757285447f1e72cefe30ddc5"
server_key_iv: "ba4733eadaaaa6bef5620ba05fb2efa1"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.007346 29330 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 18:57:10.010946 29357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.012152 29330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 18:57:10.012315 29330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "7aeaef52f416409998e8dbed78e87a7a"
format_stamp: "Formatted at 2026-08-09 18:57:09 on dist-test-slave-266d"
server_key: "f1894704757285447f1e72cefe30ddc5"
server_key_iv: "ba4733eadaaaa6bef5620ba05fb2efa1"
server_key_version: "encryptionkey@0"
I20260809 18:57:10.012539 29330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:10.027294 29330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:10.031226 29330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:10.031490 29330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:10.034336 29330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:10.034463 29330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:10.034610 29330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:10.034722 29330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:57:10 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301829, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:10.056321 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.034657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:54673 (local address 127.16.188.254:36211)
0809 18:57:10.034906 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.034912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.036141 (+ 1229us) server_negotiation.cc:407] Connection header received
0809 18:57:10.038249 (+ 2108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.038256 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.038358 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.038493 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.040282 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.041331 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.043746 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.044275 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.044412 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.049488 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:10.049495 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:10.049500 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:10.049547 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:10.052697 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.053785 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.053791 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.053795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.053950 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.054500 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.054503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.054505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.054798 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:10.054920 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.055875 (+ 955us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.056047 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 18:57:10.058261 29371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.035143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36211 (local address 127.16.188.195:54673)
0809 18:57:10.035960 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.036015 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.037933 (+ 1918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.038693 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.038701 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.039256 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:10.040089 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.040119 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.041481 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.041487 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.043526 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.043543 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.044618 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.044637 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.044946 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.045727 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:10.045766 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:10.049219 (+ 3453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:10.052835 (+ 3616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.052847 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.052864 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.053619 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.054074 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.054081 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.054085 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.054392 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.054916 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:10.054926 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:10.055423 (+ 497us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.055772 (+ 349us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.056343 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":336,"threads_started":1}
I20260809 18:57:10.074244 29112 heartbeater.cc:503] Master 127.16.188.254:36211 was elected leader, sending a full tablet report...
I20260809 18:57:10.087698 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.072342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:38727 (local address 127.16.188.254:36211)
0809 18:57:10.072543 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.072550 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.073271 (+ 721us) server_negotiation.cc:407] Connection header received
0809 18:57:10.073517 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.073523 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.073605 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.073710 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.074971 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.076244 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.077715 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.078397 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.078547 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.080751 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:10.080759 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:10.080764 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:10.080808 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:10.084684 (+ 3876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.085498 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.085504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.085508 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.085752 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.086237 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.086243 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.086247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.086563 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:10.086764 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.087262 (+ 498us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.087425 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 18:57:10.088156 29506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.072376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36211 (local address 127.16.188.195:38727)
0809 18:57:10.073137 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.073166 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.073342 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.073877 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.073884 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.074482 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:10.074796 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.074810 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.076412 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.076416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.077524 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.077545 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.078593 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.078598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.078786 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.079496 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:10.079515 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:10.080514 (+ 999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:10.084829 (+ 4315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.084834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.084838 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.085360 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.085877 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.085885 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.085889 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.086063 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.086722 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:10.086729 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:10.086977 (+ 248us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.087175 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.087550 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":352,"threads_started":1}
I20260809 18:57:10.092489 29330 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:43643
I20260809 18:57:10.092521 29555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:43643 every 8 connection(s)
I20260809 18:57:10.093817 29330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:10.094815 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 29330
I20260809 18:57:10.095027 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:10.095543 17139 external_mini_cluster.cc:1428] Setting key dba36d2e5f58af6e553458e4d41af7ef
I20260809 18:57:10.095791 29556 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36211
I20260809 18:57:10.095978 29556 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:10.096660 29556 heartbeater.cc:511] Master 127.16.188.254:36211 requested a full tablet report, sending...
I20260809 18:57:10.098038 28757 ts_manager.cc:194] Registered new tserver with Master: 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:10.098932 28757 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:54673
I20260809 18:57:10.110817 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:57:10 dist-test-slave-266d krb5kdc[28683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:57:10 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:10 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:57:10.166814 28915 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:10.156751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34140 (local address 127.16.188.254:36211)
0809 18:57:10.156989 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.156995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.157182 (+ 187us) server_negotiation.cc:407] Connection header received
0809 18:57:10.157356 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.157361 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.157436 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.157533 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.158840 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.159616 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.160820 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.161378 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.161516 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.166565 (+ 5049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34140: BlockingRecv error: recv got EOF from 127.0.0.1:34140 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 18:57:10 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301830, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:10.182235 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.169786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34144 (local address 127.16.188.254:36211)
0809 18:57:10.169943 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.169949 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.170274 (+ 325us) server_negotiation.cc:407] Connection header received
0809 18:57:10.170425 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.170430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.170503 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.170581 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.171642 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.172393 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.173616 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.174053 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.174159 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.177518 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:10.177523 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:10.177526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:10.177557 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:10.179788 (+ 2231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.180354 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.180359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.180363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.180478 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.180808 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.180813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.180852 (+ 39us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.181179 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:10.181435 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.181706 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.181921 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 18:57:10.186228 28757 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:10.193130 28757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:10.214699 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.204587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:35247 (local address 127.0.0.1:40352)
0809 18:57:10.205567 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.205620 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.205812 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.206996 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.207011 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.207055 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:10.207525 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.207539 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.209567 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.209572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.211943 (+ 2371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.211959 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.213809 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.213817 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.214004 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.214058 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.214164 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.214338 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":524,"threads_started":1}
I20260809 18:57:10.216022 29599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.205747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36640 (local address 127.16.188.195:43643)
0809 18:57:10.206767 (+ 1020us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.206774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.207332 (+ 558us) server_negotiation.cc:407] Connection header received
0809 18:57:10.207635 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.207642 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.207869 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.208025 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:10.208993 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.210811 (+ 1818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.213256 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.214617 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.214773 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.214956 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.215521 (+ 565us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.215689 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":841,"thread_start_us":911,"threads_started":1}
I20260809 18:57:10.216152 29595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.204824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40352 (local address 127.16.188.194:35247)
0809 18:57:10.206340 (+ 1516us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.206349 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.206379 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:57:10.206485 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.206492 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.206728 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.207742 (+ 1014us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:10.207968 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.209416 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.212184 (+ 2768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.213585 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.215491 (+ 1906us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.215652 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.215719 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.215884 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1374,"thread_start_us":1247,"threads_started":1}
I20260809 18:57:10.216874 29597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.205055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43643 (local address 127.0.0.1:36640)
0809 18:57:10.207212 (+ 2157us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.207233 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.207445 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.208372 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.208377 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.208401 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:10.208781 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.208793 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.210981 (+ 2188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.210986 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.213046 (+ 2060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.213062 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.215139 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.215144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.215330 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.215361 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.216404 (+ 1043us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.216532 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2030,"thread_start_us":1839,"threads_started":1}
I20260809 18:57:10.220685 29443 tablet_service.cc:1467] Processing CreateTablet for tablet 88d2fb6fb1e142e38ecc228f06eec0fb (DEFAULT_TABLE table=test-table [id=8206c7e6f91245bb8d6861afa94ccfb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:10.220680 29219 tablet_service.cc:1467] Processing CreateTablet for tablet 88d2fb6fb1e142e38ecc228f06eec0fb (DEFAULT_TABLE table=test-table [id=8206c7e6f91245bb8d6861afa94ccfb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:10.222128 29443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88d2fb6fb1e142e38ecc228f06eec0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.222182 29219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88d2fb6fb1e142e38ecc228f06eec0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.227964 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.205932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:42027 (local address 127.0.0.1:33820)
0809 18:57:10.214949 (+ 9017us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.214966 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.215057 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.217786 (+ 2729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.217791 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.217818 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:10.217975 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.217985 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.223373 (+ 5388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.223379 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.225208 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.225239 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.227098 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.227105 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.227310 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.227349 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.227453 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.227612 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8930,"thread_start_us":11409,"threads_started":1}
I20260809 18:57:10.228010 29603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.206381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33820 (local address 127.16.188.193:42027)
0809 18:57:10.217178 (+ 10797us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.217186 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.217219 (+ 33us) server_negotiation.cc:407] Connection header received
0809 18:57:10.217330 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.217338 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.217565 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.218150 (+ 585us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:10.221395 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.223187 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.225412 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.226893 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.227097 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.227295 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.227511 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.227692 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10484,"thread_start_us":10353,"threads_started":1}
I20260809 18:57:10.232553 28994 tablet_service.cc:1467] Processing CreateTablet for tablet 88d2fb6fb1e142e38ecc228f06eec0fb (DEFAULT_TABLE table=test-table [id=8206c7e6f91245bb8d6861afa94ccfb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:10.234203 28994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88d2fb6fb1e142e38ecc228f06eec0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.235527 29604 tablet_bootstrap.cc:492] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Bootstrap starting.
I20260809 18:57:10.238473 29605 tablet_bootstrap.cc:492] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Bootstrap starting.
I20260809 18:57:10.240535 29604 tablet_bootstrap.cc:654] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.241982 29604 log.cc:824] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:10.242300 29605 tablet_bootstrap.cc:654] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.243474 29605 log.cc:824] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:10.245496 29604 tablet_bootstrap.cc:492] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: No bootstrap required, opened a new log
I20260809 18:57:10.245879 29604 ts_tablet_manager.cc:1397] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260809 18:57:10.246769 29605 tablet_bootstrap.cc:492] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: No bootstrap required, opened a new log
I20260809 18:57:10.247047 29605 ts_tablet_manager.cc:1397] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 18:57:10.248006 29611 tablet_bootstrap.cc:492] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Bootstrap starting.
I20260809 18:57:10.251053 29611 tablet_bootstrap.cc:654] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.252118 29611 log.cc:824] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:10.254871 29611 tablet_bootstrap.cc:492] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: No bootstrap required, opened a new log
I20260809 18:57:10.255141 29611 ts_tablet_manager.cc:1397] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 18:57:10.256793 29604 raft_consensus.cc:348] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.257336 29604 raft_consensus.cc:374] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.257457 29604 raft_consensus.cc:729] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ce79d38c4b43b6923b30094c2f37b4, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.257858 29605 raft_consensus.cc:348] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.258280 29605 raft_consensus.cc:374] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.258380 29605 raft_consensus.cc:729] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aeaef52f416409998e8dbed78e87a7a, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.258219 29604 consensus_queue.cc:260] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.259028 29605 consensus_queue.cc:260] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.260264 29556 heartbeater.cc:503] Master 127.16.188.254:36211 was elected leader, sending a full tablet report...
I20260809 18:57:10.260977 29605 ts_tablet_manager.cc:1428] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260809 18:57:10.262454 29324 heartbeater.cc:503] Master 127.16.188.254:36211 was elected leader, sending a full tablet report...
I20260809 18:57:10.263116 29604 ts_tablet_manager.cc:1428] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Time spent starting tablet: real 0.017s user 0.014s sys 0.001s
I20260809 18:57:10.265132 29611 raft_consensus.cc:348] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.265602 29611 raft_consensus.cc:374] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.265720 29611 raft_consensus.cc:729] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a33b3ec87e4c42bd97a8033d0db17e16, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.266438 29611 consensus_queue.cc:260] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.268271 29611 ts_tablet_manager.cc:1428] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
W20260809 18:57:10.316870 29113 tablet.cc:2369] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:57:10.317667 29326 tablet.cc:2369] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:57:10.345427 29557 tablet.cc:2369] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:57:10.415779 29615 raft_consensus.cc:482] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:10.416117 29615 raft_consensus.cc:504] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.418053 29615 leader_election.cc:288] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247), 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:10.426735 29599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.418547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:58627 (local address 127.16.188.195:43643)
0809 18:57:10.418778 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.418786 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.419426 (+ 640us) server_negotiation.cc:407] Connection header received
0809 18:57:10.419566 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.419571 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.419638 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.419728 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:10.420596 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.421700 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.424613 (+ 2913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.425832 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.425989 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.426068 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.426348 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.426483 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 18:57:10.426831 29616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.418392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43643 (local address 127.16.188.193:58627)
0809 18:57:10.419327 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.419344 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.419449 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.419762 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.419768 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.419801 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:10.420434 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.420445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.421840 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.421846 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.424469 (+ 2623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.424480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.426038 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.426043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.426183 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.426216 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.426303 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.426397 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":826,"mutex_wait_us":162,"thread_start_us":415,"threads_started":1}
I20260809 18:57:10.426995 29595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.418504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:55117 (local address 127.16.188.194:35247)
0809 18:57:10.418790 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.418797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.419317 (+ 520us) server_negotiation.cc:407] Connection header received
0809 18:57:10.419542 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.419547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.419628 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.419728 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:10.420599 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.421709 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.424613 (+ 2904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.425824 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.425989 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.426068 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.426586 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.426727 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260809 18:57:10.427367 29617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.418287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:35247 (local address 127.16.188.193:55117)
0809 18:57:10.419189 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.419212 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.419396 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.419762 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.419768 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.419873 (+ 105us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:10.420430 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.420445 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.421876 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.421882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.424442 (+ 2560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.424464 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.426222 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.426226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.426395 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.426428 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.426525 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.426648 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"mutex_wait_us":125,"spinlock_wait_cycles":23424,"thread_start_us":741,"threads_started":1}
I20260809 18:57:10.427944 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d2fb6fb1e142e38ecc228f06eec0fb" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeaef52f416409998e8dbed78e87a7a" is_pre_election: true
I20260809 18:57:10.428285 29250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d2fb6fb1e142e38ecc228f06eec0fb" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ce79d38c4b43b6923b30094c2f37b4" is_pre_election: true
I20260809 18:57:10.428439 29483 raft_consensus.cc:2454] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 0.
I20260809 18:57:10.428892 29250 raft_consensus.cc:2454] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 0.
I20260809 18:57:10.429121 28899 leader_election.cc:302] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aeaef52f416409998e8dbed78e87a7a, a33b3ec87e4c42bd97a8033d0db17e16; no voters:
I20260809 18:57:10.429524 29615 raft_consensus.cc:2781] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:10.429663 29615 raft_consensus.cc:482] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:10.429769 29615 raft_consensus.cc:3037] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.431891 29615 raft_consensus.cc:504] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.432485 29615 leader_election.cc:288] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 election: Requested vote from peers 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247), 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:10.432890 29250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d2fb6fb1e142e38ecc228f06eec0fb" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ce79d38c4b43b6923b30094c2f37b4"
I20260809 18:57:10.432934 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88d2fb6fb1e142e38ecc228f06eec0fb" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeaef52f416409998e8dbed78e87a7a"
I20260809 18:57:10.433133 29483 raft_consensus.cc:3037] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.433133 29250 raft_consensus.cc:3037] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.436236 29483 raft_consensus.cc:2454] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 1.
I20260809 18:57:10.436236 29250 raft_consensus.cc:2454] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 1.
I20260809 18:57:10.436620 28899 leader_election.cc:302] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aeaef52f416409998e8dbed78e87a7a, a33b3ec87e4c42bd97a8033d0db17e16; no voters:
I20260809 18:57:10.436885 29615 raft_consensus.cc:2781] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:10.437316 29615 raft_consensus.cc:686] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 LEADER]: Becoming Leader. State: Replica: a33b3ec87e4c42bd97a8033d0db17e16, State: Running, Role: LEADER
I20260809 18:57:10.437781 29615 consensus_queue.cc:237] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.442179 28757 catalog_manager.cc:5495] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193). New cstate: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:10.513335 29603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.507583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33828 (local address 127.16.188.193:42027)
0809 18:57:10.507802 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.507809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.507831 (+ 22us) server_negotiation.cc:407] Connection header received
0809 18:57:10.508034 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.508038 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.508137 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.508287 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:10.508702 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.509505 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.511041 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.511486 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.511613 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.512096 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:10.512665 (+ 569us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:10.512822 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.512919 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.513012 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:57:10.521361 29483 raft_consensus.cc:1261] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Refusing update from remote peer a33b3ec87e4c42bd97a8033d0db17e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:10.521409 29250 raft_consensus.cc:1261] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Refusing update from remote peer a33b3ec87e4c42bd97a8033d0db17e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:10.522305 29615 consensus_queue.cc:1035] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:10.522610 29620 consensus_queue.cc:1035] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:10.533564 29627 mvcc.cc:205] Tried to move back new op lower bound from 7316692297805922304 to 7316692297476956160. Current Snapshot: MvccSnapshot[applied={T|T < 7316692297805922304}]
I20260809 18:57:10.534849 29630 mvcc.cc:205] Tried to move back new op lower bound from 7316692297805922304 to 7316692297476956160. Current Snapshot: MvccSnapshot[applied={T|T < 7316692297805922304}]
I20260809 18:57:10.548223 28757 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:10.548532 28757 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:10.552320 28757 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: Sending DeleteTablet for 3 replicas of tablet 88d2fb6fb1e142e38ecc228f06eec0fb
I20260809 18:57:10.553542 28994 tablet_service.cc:1514] Processing DeleteTablet for tablet 88d2fb6fb1e142e38ecc228f06eec0fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:10 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:33820
I20260809 18:57:10.553567 29219 tablet_service.cc:1514] Processing DeleteTablet for tablet 88d2fb6fb1e142e38ecc228f06eec0fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:10 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:40352
I20260809 18:57:10.553634 29443 tablet_service.cc:1514] Processing DeleteTablet for tablet 88d2fb6fb1e142e38ecc228f06eec0fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:10 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:36640
I20260809 18:57:10.554322 29641 tablet_replica.cc:330] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: stopping tablet replica
I20260809 18:57:10.554739 29641 raft_consensus.cc:2229] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:10.555378 29641 raft_consensus.cc:2258] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:10.555500 28757 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:10.556504 28757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:10.557335 29641 ts_tablet_manager.cc:1905] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:10.563843 29442 tablet_service.cc:1467] Processing CreateTablet for tablet 6525f95eba1f4560a83a17413f1e6a33 (DEFAULT_TABLE table=test-table [id=4de4b30df89f4089bfc421d89d31f414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:10.563930 29218 tablet_service.cc:1467] Processing CreateTablet for tablet 6525f95eba1f4560a83a17413f1e6a33 (DEFAULT_TABLE table=test-table [id=4de4b30df89f4089bfc421d89d31f414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:10.564319 29442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6525f95eba1f4560a83a17413f1e6a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.564532 29218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6525f95eba1f4560a83a17413f1e6a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.565215 29641 ts_tablet_manager.cc:1918] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:10.565358 29641 log.cc:1196] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/88d2fb6fb1e142e38ecc228f06eec0fb
I20260809 18:57:10.565847 29641 ts_tablet_manager.cc:1939] T 88d2fb6fb1e142e38ecc228f06eec0fb P a33b3ec87e4c42bd97a8033d0db17e16: Deleting consensus metadata
I20260809 18:57:10.567426 28737 catalog_manager.cc:4841] TS a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027): tablet 88d2fb6fb1e142e38ecc228f06eec0fb (table test-table [id=8206c7e6f91245bb8d6861afa94ccfb5]) successfully deleted
I20260809 18:57:10.567624 28994 tablet_service.cc:1467] Processing CreateTablet for tablet 6525f95eba1f4560a83a17413f1e6a33 (DEFAULT_TABLE table=test-table [id=4de4b30df89f4089bfc421d89d31f414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:10.567996 28994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6525f95eba1f4560a83a17413f1e6a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.571161 29605 tablet_bootstrap.cc:492] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: Bootstrap starting.
I20260809 18:57:10.572882 29605 tablet_bootstrap.cc:654] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.573648 29611 tablet_bootstrap.cc:492] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: Bootstrap starting.
I20260809 18:57:10.575090 29611 tablet_bootstrap.cc:654] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.579900 29643 tablet_replica.cc:330] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: stopping tablet replica
I20260809 18:57:10.580397 29643 raft_consensus.cc:2229] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:10.581549 29604 tablet_bootstrap.cc:492] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: Bootstrap starting.
I20260809 18:57:10.582955 29643 raft_consensus.cc:2258] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:10.583027 29604 tablet_bootstrap.cc:654] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.583051 29605 tablet_bootstrap.cc:492] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: No bootstrap required, opened a new log
I20260809 18:57:10.583192 29605 ts_tablet_manager.cc:1397] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260809 18:57:10.584252 29605 raft_consensus.cc:348] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.584586 29605 raft_consensus.cc:374] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.584734 29605 raft_consensus.cc:729] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aeaef52f416409998e8dbed78e87a7a, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.585178 29605 consensus_queue.cc:260] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.588647 29605 ts_tablet_manager.cc:1428] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 18:57:10.589540 29614 raft_consensus.cc:482] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:10.589747 29614 raft_consensus.cc:504] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.590588 29611 tablet_bootstrap.cc:492] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: No bootstrap required, opened a new log
I20260809 18:57:10.590716 29611 ts_tablet_manager.cc:1397] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.006s
I20260809 18:57:10.591070 29647 tablet_replica.cc:330] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: stopping tablet replica
I20260809 18:57:10.591459 29647 raft_consensus.cc:2229] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:10.591457 29611 raft_consensus.cc:348] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.591645 29611 raft_consensus.cc:374] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.591658 29643 ts_tablet_manager.cc:1905] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:10.591732 29611 raft_consensus.cc:729] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a33b3ec87e4c42bd97a8033d0db17e16, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.591933 29647 raft_consensus.cc:2258] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:10.591985 29611 consensus_queue.cc:260] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.593302 29611 ts_tablet_manager.cc:1428] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:57:10.595908 29614 leader_election.cc:288] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027), 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247)
I20260809 18:57:10.600474 29604 tablet_bootstrap.cc:492] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: No bootstrap required, opened a new log
I20260809 18:57:10.600685 29604 ts_tablet_manager.cc:1397] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.008s
I20260809 18:57:10.601589 29604 raft_consensus.cc:348] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.601887 29604 raft_consensus.cc:374] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.602023 29604 raft_consensus.cc:729] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ce79d38c4b43b6923b30094c2f37b4, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.602373 29604 consensus_queue.cc:260] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.605190 29604 ts_tablet_manager.cc:1428] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 18:57:10.608765 29647 ts_tablet_manager.cc:1905] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:10.609445 29603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.596512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:47847 (local address 127.16.188.193:42027)
0809 18:57:10.596676 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.596682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.599457 (+ 2775us) server_negotiation.cc:407] Connection header received
0809 18:57:10.599755 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.599762 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.599837 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.599902 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:10.600622 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.601841 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.605326 (+ 3485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.606653 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.606799 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.606915 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.608938 (+ 2023us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.609080 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:57:10.610196 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.596026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:42027 (local address 127.16.188.195:47847)
0809 18:57:10.599341 (+ 3315us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.599362 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.599576 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.600120 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.600125 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.600155 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:10.600401 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.600415 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.603143 (+ 2728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.603149 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.605075 (+ 1926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.605125 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.608494 (+ 3369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.608501 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.608722 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.608762 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.609648 (+ 886us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.609800 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3176,"thread_start_us":3020,"threads_started":1}
I20260809 18:57:10.613251 29643 ts_tablet_manager.cc:1918] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:10.619112 29595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.599585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:59829 (local address 127.16.188.194:35247)
0809 18:57:10.599753 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.599759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.610642 (+ 10883us) server_negotiation.cc:407] Connection header received
0809 18:57:10.610929 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.610936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.611013 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.611083 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:10.611743 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.612843 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.616362 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.617745 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.617898 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.617980 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.618662 (+ 682us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.618797 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:57:10.619508 29643 log.cc:1196] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/88d2fb6fb1e142e38ecc228f06eec0fb
I20260809 18:57:10.619804 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.599539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:35247 (local address 127.16.188.195:59829)
0809 18:57:10.610526 (+ 10987us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.610546 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.610755 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.611335 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.611340 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.611368 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:10.611539 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.611551 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.613054 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.613060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.616081 (+ 3021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.616098 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.618205 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.618211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.618438 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.618477 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.619299 (+ 822us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.619466 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10887,"threads_started":1}
I20260809 18:57:10.619812 29647 ts_tablet_manager.cc:1918] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:10.619951 29647 log.cc:1196] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/88d2fb6fb1e142e38ecc228f06eec0fb
I20260809 18:57:10.620311 29643 ts_tablet_manager.cc:1939] T 88d2fb6fb1e142e38ecc228f06eec0fb P 7aeaef52f416409998e8dbed78e87a7a: Deleting consensus metadata
I20260809 18:57:10.621519 29647 ts_tablet_manager.cc:1939] T 88d2fb6fb1e142e38ecc228f06eec0fb P 39ce79d38c4b43b6923b30094c2f37b4: Deleting consensus metadata
I20260809 18:57:10.622319 28734 catalog_manager.cc:4841] TS 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643): tablet 88d2fb6fb1e142e38ecc228f06eec0fb (table test-table [id=8206c7e6f91245bb8d6861afa94ccfb5]) successfully deleted
I20260809 18:57:10.623167 28737 catalog_manager.cc:4841] TS 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247): tablet 88d2fb6fb1e142e38ecc228f06eec0fb (table test-table [id=8206c7e6f91245bb8d6861afa94ccfb5]) successfully deleted
I20260809 18:57:10.623739 29250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6525f95eba1f4560a83a17413f1e6a33" candidate_uuid: "7aeaef52f416409998e8dbed78e87a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ce79d38c4b43b6923b30094c2f37b4" is_pre_election: true
I20260809 18:57:10.624004 29250 raft_consensus.cc:2454] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aeaef52f416409998e8dbed78e87a7a in term 0.
I20260809 18:57:10.624239 29029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6525f95eba1f4560a83a17413f1e6a33" candidate_uuid: "7aeaef52f416409998e8dbed78e87a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" is_pre_election: true
I20260809 18:57:10.624729 29029 raft_consensus.cc:2454] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aeaef52f416409998e8dbed78e87a7a in term 0.
I20260809 18:57:10.625434 29365 leader_election.cc:302] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39ce79d38c4b43b6923b30094c2f37b4, 7aeaef52f416409998e8dbed78e87a7a; no voters:
I20260809 18:57:10.625835 29614 raft_consensus.cc:2781] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:10.625974 29614 raft_consensus.cc:482] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:10.626080 29614 raft_consensus.cc:3037] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.629283 29614 raft_consensus.cc:504] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.630087 29614 leader_election.cc:288] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [CANDIDATE]: Term 1 election: Requested vote from peers a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027), 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247)
I20260809 18:57:10.630481 29029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6525f95eba1f4560a83a17413f1e6a33" candidate_uuid: "7aeaef52f416409998e8dbed78e87a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a33b3ec87e4c42bd97a8033d0db17e16"
I20260809 18:57:10.630546 29250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6525f95eba1f4560a83a17413f1e6a33" candidate_uuid: "7aeaef52f416409998e8dbed78e87a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ce79d38c4b43b6923b30094c2f37b4"
I20260809 18:57:10.630721 29250 raft_consensus.cc:3037] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.630750 29029 raft_consensus.cc:3037] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.632663 29250 raft_consensus.cc:2454] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aeaef52f416409998e8dbed78e87a7a in term 1.
I20260809 18:57:10.633041 29365 leader_election.cc:302] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39ce79d38c4b43b6923b30094c2f37b4, 7aeaef52f416409998e8dbed78e87a7a; no voters:
I20260809 18:57:10.633334 29614 raft_consensus.cc:2781] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:10.633744 29614 raft_consensus.cc:686] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 1 LEADER]: Becoming Leader. State: Replica: 7aeaef52f416409998e8dbed78e87a7a, State: Running, Role: LEADER
I20260809 18:57:10.634128 29614 consensus_queue.cc:237] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.634500 29029 raft_consensus.cc:2454] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aeaef52f416409998e8dbed78e87a7a in term 1.
I20260809 18:57:10.637840 28757 catalog_manager.cc:5495] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195). New cstate: current_term: 1 leader_uuid: "7aeaef52f416409998e8dbed78e87a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } health_report { overall_health: HEALTHY } } }
Aug 09 18:57:10 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301828, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.254@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:10.695217 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.675484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36211 (local address 127.0.0.1:34156)
0809 18:57:10.676197 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.676218 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.676389 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.676704 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.676709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.677731 (+ 1022us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:10.678125 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.678139 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.679177 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.679183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.680764 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.680780 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.681566 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.681573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.681754 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.682479 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:10.682503 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:10.685203 (+ 2700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:10.692717 (+ 7514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.692732 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.692740 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.693243 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.693660 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:10.693664 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:10.693666 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:10.693800 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:10.694392 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:10.694399 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:10.694565 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.694691 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.694909 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":340,"threads_started":1}
I20260809 18:57:10.695490 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.675476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.16.188.254:36211)
0809 18:57:10.675680 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.675687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.676303 (+ 616us) server_negotiation.cc:407] Connection header received
0809 18:57:10.676500 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.676503 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.676560 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.676640 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:10.678266 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.679014 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.680922 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.681383 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.681494 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.685418 (+ 3924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:10.685424 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:10.685430 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:10.685468 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:10.692565 (+ 7097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.693368 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.693374 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.693378 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.693554 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:10.693909 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:10.693914 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:10.693918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:10.694282 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:10.694455 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.694843 (+ 388us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.695073 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 18:57:10.704159 28757 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:34156:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:57:10.705221 28757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:10.711694 29219 tablet_service.cc:1467] Processing CreateTablet for tablet 78338003339846339136b2f5e0767218 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65c661263d8543a39befd6d290a6362e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:57:10.711828 28994 tablet_service.cc:1467] Processing CreateTablet for tablet 78338003339846339136b2f5e0767218 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65c661263d8543a39befd6d290a6362e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:57:10.712258 29219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78338003339846339136b2f5e0767218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.712422 28994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78338003339846339136b2f5e0767218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.716512 29443 tablet_service.cc:1467] Processing CreateTablet for tablet 78338003339846339136b2f5e0767218 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65c661263d8543a39befd6d290a6362e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:57:10.717124 29443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78338003339846339136b2f5e0767218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:10.717990 29604 tablet_bootstrap.cc:492] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: Bootstrap starting.
I20260809 18:57:10.719463 29611 tablet_bootstrap.cc:492] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: Bootstrap starting.
I20260809 18:57:10.719574 29604 tablet_bootstrap.cc:654] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.721004 29611 tablet_bootstrap.cc:654] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.724004 29605 tablet_bootstrap.cc:492] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: Bootstrap starting.
I20260809 18:57:10.725636 29604 tablet_bootstrap.cc:492] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: No bootstrap required, opened a new log
I20260809 18:57:10.725813 29604 ts_tablet_manager.cc:1397] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 18:57:10.726154 29605 tablet_bootstrap.cc:654] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:10.726574 29604 raft_consensus.cc:348] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.726831 29604 raft_consensus.cc:374] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.726917 29604 raft_consensus.cc:729] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ce79d38c4b43b6923b30094c2f37b4, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.728129 29604 consensus_queue.cc:260] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.728600 29613 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.728969 29613 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:10.732439 29604 ts_tablet_manager.cc:1428] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260809 18:57:10.734297 29611 tablet_bootstrap.cc:492] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: No bootstrap required, opened a new log
I20260809 18:57:10.734489 29611 ts_tablet_manager.cc:1397] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260809 18:57:10.735324 29611 raft_consensus.cc:348] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.735611 29611 raft_consensus.cc:374] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.735697 29611 raft_consensus.cc:729] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a33b3ec87e4c42bd97a8033d0db17e16, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.735968 29611 consensus_queue.cc:260] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.736444 29634 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.736856 29634 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:10.737386 29611 ts_tablet_manager.cc:1428] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 18:57:10.739305 29605 tablet_bootstrap.cc:492] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: No bootstrap required, opened a new log
I20260809 18:57:10.739465 29605 ts_tablet_manager.cc:1397] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.004s
I20260809 18:57:10.740044 29605 raft_consensus.cc:348] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.740290 29605 raft_consensus.cc:374] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:10.740365 29605 raft_consensus.cc:729] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aeaef52f416409998e8dbed78e87a7a, State: Initialized, Role: FOLLOWER
I20260809 18:57:10.740592 29605 consensus_queue.cc:260] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.741160 29605 ts_tablet_manager.cc:1428] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:57:10.740993 29614 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.741314 29614 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:10.782238 29634 raft_consensus.cc:482] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:10.782450 29634 raft_consensus.cc:504] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.783195 29634 leader_election.cc:288] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247), 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:10.783743 29250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78338003339846339136b2f5e0767218" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ce79d38c4b43b6923b30094c2f37b4" is_pre_election: true
I20260809 18:57:10.783823 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78338003339846339136b2f5e0767218" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeaef52f416409998e8dbed78e87a7a" is_pre_election: true
I20260809 18:57:10.783986 29250 raft_consensus.cc:2454] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 0.
I20260809 18:57:10.784101 29483 raft_consensus.cc:2454] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 0.
I20260809 18:57:10.784399 28904 leader_election.cc:302] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39ce79d38c4b43b6923b30094c2f37b4, a33b3ec87e4c42bd97a8033d0db17e16; no voters:
I20260809 18:57:10.784672 29634 raft_consensus.cc:2781] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:10.784801 29634 raft_consensus.cc:482] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:10.784898 29634 raft_consensus.cc:3037] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.787461 29634 raft_consensus.cc:504] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.788041 29634 leader_election.cc:288] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 election: Requested vote from peers 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247), 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:10.788439 29250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78338003339846339136b2f5e0767218" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ce79d38c4b43b6923b30094c2f37b4"
I20260809 18:57:10.788672 29250 raft_consensus.cc:3037] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.788589 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78338003339846339136b2f5e0767218" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeaef52f416409998e8dbed78e87a7a"
I20260809 18:57:10.788820 29483 raft_consensus.cc:3037] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:10.791532 29250 raft_consensus.cc:2454] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 1.
I20260809 18:57:10.791596 29483 raft_consensus.cc:2454] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 1.
I20260809 18:57:10.791961 28904 leader_election.cc:302] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 39ce79d38c4b43b6923b30094c2f37b4, 7aeaef52f416409998e8dbed78e87a7a, a33b3ec87e4c42bd97a8033d0db17e16; no voters:
I20260809 18:57:10.792400 29634 raft_consensus.cc:2781] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:10.792542 29634 raft_consensus.cc:686] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 LEADER]: Becoming Leader. State: Replica: a33b3ec87e4c42bd97a8033d0db17e16, State: Running, Role: LEADER
I20260809 18:57:10.792809 29634 consensus_queue.cc:237] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:10.794606 29615 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: TxnStatusTablet state changed. Reason: New leader a33b3ec87e4c42bd97a8033d0db17e16. Latest consensus state: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.794894 29615 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:57:10.795588 29681 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:57:10.795845 29681 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:57:10.796149 28757 catalog_manager.cc:5495] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193). New cstate: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:10.829686 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.824775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:42027 (local address 127.0.0.1:33832)
0809 18:57:10.824991 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.825009 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.825171 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.825608 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.825613 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.825626 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:10.825822 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.825834 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.826860 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.826866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.827840 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.827852 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.828583 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.828589 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.828729 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.828791 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:10.829158 (+ 367us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:10.829181 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.829254 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.829404 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 18:57:10.829670 29603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.825120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33832 (local address 127.16.188.193:42027)
0809 18:57:10.825328 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.825337 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.825353 (+ 16us) server_negotiation.cc:407] Connection header received
0809 18:57:10.825409 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.825413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.825477 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.825558 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:10.825968 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.826729 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.827978 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.828431 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.828545 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.828949 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:10.829047 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:10.829162 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.829291 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.829368 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 18:57:10.833163 29483 raft_consensus.cc:1261] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Refusing update from remote peer a33b3ec87e4c42bd97a8033d0db17e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:10.833374 29250 raft_consensus.cc:1261] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Refusing update from remote peer a33b3ec87e4c42bd97a8033d0db17e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:10.833884 29615 consensus_queue.cc:1035] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:10.834177 29634 consensus_queue.cc:1035] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:10.841977 29614 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: TxnStatusTablet state changed. Reason: New leader a33b3ec87e4c42bd97a8033d0db17e16. Latest consensus state: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.842306 29614 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:10.845290 29620 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.845643 29620 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:57:10.845955 29613 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: TxnStatusTablet state changed. Reason: New leader a33b3ec87e4c42bd97a8033d0db17e16. Latest consensus state: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.846225 29613 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:10.847711 29628 mvcc.cc:205] Tried to move back new op lower bound from 7316692299086884864 to 7316692298930073600. Current Snapshot: MvccSnapshot[applied={T|T < 7316692299086884864}]
I20260809 18:57:10.848063 29614 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.848345 29614 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P 7aeaef52f416409998e8dbed78e87a7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:10.849714 29620 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.849972 29620 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P a33b3ec87e4c42bd97a8033d0db17e16: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:57:10.851982 29613 tablet_replica.cc:439] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } } }
I20260809 18:57:10.852219 29613 tablet_replica.cc:442] T 78338003339846339136b2f5e0767218 P 39ce79d38c4b43b6923b30094c2f37b4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:57:10.862659 29599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.853173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36646 (local address 127.16.188.195:43643)
0809 18:57:10.853331 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.853337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.853640 (+ 303us) server_negotiation.cc:407] Connection header received
0809 18:57:10.853740 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.853745 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.853863 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.854013 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:10.854632 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.855741 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.859838 (+ 4097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.860457 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.860589 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.861202 (+ 613us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:10.861953 (+ 751us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:10.862102 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.862214 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.862307 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 18:57:10.888197 29603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.873600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:43193 (local address 127.16.188.193:42027)
0809 18:57:10.874777 (+ 1177us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.874783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.881802 (+ 7019us) server_negotiation.cc:407] Connection header received
0809 18:57:10.881966 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.881972 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.882067 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.882178 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:10.882761 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.883878 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.885952 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.886643 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.886766 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.887320 (+ 554us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:10.887522 (+ 202us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:10.887620 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.887775 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.887864 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":998}
I20260809 18:57:10.888502 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.873489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:42027 (local address 127.16.188.195:43193)
0809 18:57:10.881707 (+ 8218us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.881727 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.881852 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.882202 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.882208 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.882224 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:10.882588 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.882601 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.884020 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.884026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.885805 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.885821 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.886850 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.886857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.887032 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.887106 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:10.887640 (+ 534us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:10.887654 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.887743 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.887893 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7968,"thread_start_us":7778,"threads_started":1}
I20260809 18:57:10.899045 29250 raft_consensus.cc:1261] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Refusing update from remote peer 7aeaef52f416409998e8dbed78e87a7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:10.899487 29029 raft_consensus.cc:1261] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Refusing update from remote peer 7aeaef52f416409998e8dbed78e87a7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:10.899775 29660 consensus_queue.cc:1035] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:10.900175 29614 consensus_queue.cc:1035] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:10.952616 29599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.946734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:42717 (local address 127.16.188.195:43643)
0809 18:57:10.946910 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:10.946915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:10.947094 (+ 179us) server_negotiation.cc:407] Connection header received
0809 18:57:10.947244 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:10.947249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:10.947319 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:10.947385 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:10.947953 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.948863 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.950714 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.951271 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.951352 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.951936 (+ 584us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:10.952051 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:10.952111 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:10.952285 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 18:57:10.952359 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 18:57:10.953351 29699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:10.946336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43643 (local address 127.16.188.193:42717)
0809 18:57:10.946977 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:10.946998 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:10.947129 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:10.947526 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:10.947531 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:10.947542 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:10.947788 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.947797 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.949046 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.949051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.950563 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:10.950577 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:10.951533 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:10.951539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:10.951694 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:10.951755 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:10.952178 (+ 423us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:10.952188 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 18:57:10.952832 (+ 644us) client_negotiation.cc:240] Negotiation successful
0809 18:57:10.952955 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":588,"threads_started":1}
I20260809 18:57:10.992954 28758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:10.993248 28758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:10.996713 28758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: Sending DeleteTablet for 3 replicas of tablet 6525f95eba1f4560a83a17413f1e6a33
I20260809 18:57:10.997447 28994 tablet_service.cc:1514] Processing DeleteTablet for tablet 6525f95eba1f4560a83a17413f1e6a33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:10 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:33820
I20260809 18:57:10.997768 29443 tablet_service.cc:1514] Processing DeleteTablet for tablet 6525f95eba1f4560a83a17413f1e6a33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:10 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:36640
I20260809 18:57:10.998072 29641 tablet_replica.cc:330] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: stopping tablet replica
I20260809 18:57:10.998075 29643 tablet_replica.cc:330] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: stopping tablet replica
I20260809 18:57:10.998289 29643 raft_consensus.cc:2229] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:10.998286 29641 raft_consensus.cc:2229] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:10.998497 29641 raft_consensus.cc:2258] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:10.998793 29643 raft_consensus.cc:2258] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:11.000151 29643 ts_tablet_manager.cc:1905] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:11.000197 29641 ts_tablet_manager.cc:1905] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:11.002720 29219 tablet_service.cc:1514] Processing DeleteTablet for tablet 6525f95eba1f4560a83a17413f1e6a33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:10 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:40352
I20260809 18:57:11.003013 29647 tablet_replica.cc:330] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: stopping tablet replica
I20260809 18:57:11.003208 29647 raft_consensus.cc:2229] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:11.003382 29647 raft_consensus.cc:2258] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:11.007943 29643 ts_tablet_manager.cc:1918] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:11.008917 29647 ts_tablet_manager.cc:1905] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:11.016144 29641 ts_tablet_manager.cc:1918] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:11.016157 29647 ts_tablet_manager.cc:1918] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:11.016520 29647 log.cc:1196] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/6525f95eba1f4560a83a17413f1e6a33
I20260809 18:57:11.017199 29647 ts_tablet_manager.cc:1939] T 6525f95eba1f4560a83a17413f1e6a33 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting consensus metadata
I20260809 18:57:11.018548 28737 catalog_manager.cc:4841] TS 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247): tablet 6525f95eba1f4560a83a17413f1e6a33 (table test-table [id=4de4b30df89f4089bfc421d89d31f414]) successfully deleted
I20260809 18:57:11.018981 29643 log.cc:1196] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/6525f95eba1f4560a83a17413f1e6a33
I20260809 18:57:11.019543 29643 ts_tablet_manager.cc:1939] T 6525f95eba1f4560a83a17413f1e6a33 P 7aeaef52f416409998e8dbed78e87a7a: Deleting consensus metadata
I20260809 18:57:11.020750 28734 catalog_manager.cc:4841] TS 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643): tablet 6525f95eba1f4560a83a17413f1e6a33 (table test-table [id=4de4b30df89f4089bfc421d89d31f414]) successfully deleted
I20260809 18:57:11.021250 29641 log.cc:1196] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/6525f95eba1f4560a83a17413f1e6a33
I20260809 18:57:11.021731 29641 ts_tablet_manager.cc:1939] T 6525f95eba1f4560a83a17413f1e6a33 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting consensus metadata
I20260809 18:57:11.022907 28737 catalog_manager.cc:4841] TS a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027): tablet 6525f95eba1f4560a83a17413f1e6a33 (table test-table [id=4de4b30df89f4089bfc421d89d31f414]) successfully deleted
Aug 09 18:57:11 dist-test-slave-266d krb5kdc[28683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:57:11 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:11 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:57:11.136433 28915 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:11.122804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34162 (local address 127.16.188.254:36211)
0809 18:57:11.123037 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.123045 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.123769 (+ 724us) server_negotiation.cc:407] Connection header received
0809 18:57:11.124067 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.124074 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.124159 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.124234 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.126156 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.127294 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.129235 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.129942 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.130040 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.136136 (+ 6096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34162: BlockingRecv error: recv got EOF from 127.0.0.1:34162 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 18:57:11 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM
I20260809 18:57:11.166716 28915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.144643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34170 (local address 127.16.188.254:36211)
0809 18:57:11.144842 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.144848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.149579 (+ 4731us) server_negotiation.cc:407] Connection header received
0809 18:57:11.149782 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.149788 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.149866 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.149969 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.151506 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.152629 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.154534 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.155203 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.155329 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.160143 (+ 4814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:11.160150 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:11.160156 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:11.160198 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:11.163808 (+ 3610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:11.164560 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:11.164566 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:11.164570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:11.164726 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:11.165137 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:11.165142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:11.165146 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:11.165504 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:11.165743 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.166070 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.166308 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 18:57:11.170610 28758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:11.171351 28758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:11.179694 29219 tablet_service.cc:1467] Processing CreateTablet for tablet c69ef78dc7584a878e5b63a071b5a2b0 (DEFAULT_TABLE table=test-table [id=6ecdc76677e24546b52d125e48b0e3aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:11.179853 29443 tablet_service.cc:1467] Processing CreateTablet for tablet c69ef78dc7584a878e5b63a071b5a2b0 (DEFAULT_TABLE table=test-table [id=6ecdc76677e24546b52d125e48b0e3aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:11.180154 29219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69ef78dc7584a878e5b63a071b5a2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:11.180301 29443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69ef78dc7584a878e5b63a071b5a2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:11.185536 28994 tablet_service.cc:1467] Processing CreateTablet for tablet c69ef78dc7584a878e5b63a071b5a2b0 (DEFAULT_TABLE table=test-table [id=6ecdc76677e24546b52d125e48b0e3aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:11.185992 28994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69ef78dc7584a878e5b63a071b5a2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:11.187778 29605 tablet_bootstrap.cc:492] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Bootstrap starting.
I20260809 18:57:11.189494 29605 tablet_bootstrap.cc:654] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:11.194154 29604 tablet_bootstrap.cc:492] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: Bootstrap starting.
I20260809 18:57:11.195696 29604 tablet_bootstrap.cc:654] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:11.198411 29605 tablet_bootstrap.cc:492] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: No bootstrap required, opened a new log
I20260809 18:57:11.198637 29605 ts_tablet_manager.cc:1397] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260809 18:57:11.198995 29611 tablet_bootstrap.cc:492] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: Bootstrap starting.
I20260809 18:57:11.199715 29605 raft_consensus.cc:348] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.200170 29605 raft_consensus.cc:374] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:11.200379 29605 raft_consensus.cc:729] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aeaef52f416409998e8dbed78e87a7a, State: Initialized, Role: FOLLOWER
I20260809 18:57:11.200627 29611 tablet_bootstrap.cc:654] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:11.200834 29605 consensus_queue.cc:260] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.204464 29605 ts_tablet_manager.cc:1428] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260809 18:57:11.214537 29611 tablet_bootstrap.cc:492] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: No bootstrap required, opened a new log
I20260809 18:57:11.214706 29611 ts_tablet_manager.cc:1397] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.004s
I20260809 18:57:11.215480 29611 raft_consensus.cc:348] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.215757 29611 raft_consensus.cc:374] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:11.215862 29611 raft_consensus.cc:729] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a33b3ec87e4c42bd97a8033d0db17e16, State: Initialized, Role: FOLLOWER
I20260809 18:57:11.216090 29611 consensus_queue.cc:260] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.218185 29604 tablet_bootstrap.cc:492] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: No bootstrap required, opened a new log
I20260809 18:57:11.218395 29604 ts_tablet_manager.cc:1397] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.008s
I20260809 18:57:11.219255 29604 raft_consensus.cc:348] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.219449 29611 ts_tablet_manager.cc:1428] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260809 18:57:11.219604 29604 raft_consensus.cc:374] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:11.219758 29604 raft_consensus.cc:729] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ce79d38c4b43b6923b30094c2f37b4, State: Initialized, Role: FOLLOWER
I20260809 18:57:11.220094 29604 consensus_queue.cc:260] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.220726 29604 ts_tablet_manager.cc:1428] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 18:57:11.395716 29620 raft_consensus.cc:482] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:11.395965 29620 raft_consensus.cc:504] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.396661 29620 leader_election.cc:288] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247), 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:11.397455 29250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69ef78dc7584a878e5b63a071b5a2b0" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ce79d38c4b43b6923b30094c2f37b4" is_pre_election: true
I20260809 18:57:11.397739 29250 raft_consensus.cc:2454] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 0.
I20260809 18:57:11.398308 28904 leader_election.cc:302] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39ce79d38c4b43b6923b30094c2f37b4, a33b3ec87e4c42bd97a8033d0db17e16; no voters:
I20260809 18:57:11.398595 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69ef78dc7584a878e5b63a071b5a2b0" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeaef52f416409998e8dbed78e87a7a" is_pre_election: true
I20260809 18:57:11.398869 29479 raft_consensus.cc:2454] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 0.
I20260809 18:57:11.398922 29615 raft_consensus.cc:2781] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:11.399046 29615 raft_consensus.cc:482] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:11.399142 29615 raft_consensus.cc:3037] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:11.402482 29615 raft_consensus.cc:504] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.403585 29250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69ef78dc7584a878e5b63a071b5a2b0" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ce79d38c4b43b6923b30094c2f37b4"
I20260809 18:57:11.403811 29250 raft_consensus.cc:3037] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:11.403957 29615 leader_election.cc:288] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 election: Requested vote from peers 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247), 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:11.404282 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69ef78dc7584a878e5b63a071b5a2b0" candidate_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeaef52f416409998e8dbed78e87a7a"
I20260809 18:57:11.404481 29479 raft_consensus.cc:3037] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:11.406761 29250 raft_consensus.cc:2454] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 1.
I20260809 18:57:11.407205 28904 leader_election.cc:302] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39ce79d38c4b43b6923b30094c2f37b4, a33b3ec87e4c42bd97a8033d0db17e16; no voters:
I20260809 18:57:11.407527 29615 raft_consensus.cc:2781] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:11.407655 29479 raft_consensus.cc:2454] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a33b3ec87e4c42bd97a8033d0db17e16 in term 1.
I20260809 18:57:11.407992 29615 raft_consensus.cc:686] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 LEADER]: Becoming Leader. State: Replica: a33b3ec87e4c42bd97a8033d0db17e16, State: Running, Role: LEADER
I20260809 18:57:11.408282 29615 consensus_queue.cc:237] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.411207 28758 catalog_manager.cc:5495] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193). New cstate: current_term: 1 leader_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:11.475795 29734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.466217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33846 (local address 127.16.188.193:42027)
0809 18:57:11.471081 (+ 4864us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.471085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.471103 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:57:11.471164 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.471168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.471234 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.471746 (+ 512us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:11.471885 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.472645 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.474085 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.474512 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.474629 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.475050 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:11.475149 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:11.475223 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.475378 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.475459 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4758,"thread_start_us":4603,"threads_started":1}
I20260809 18:57:11.478995 29479 raft_consensus.cc:1261] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Refusing update from remote peer a33b3ec87e4c42bd97a8033d0db17e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:11.479636 29250 raft_consensus.cc:1261] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Refusing update from remote peer a33b3ec87e4c42bd97a8033d0db17e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:11.479651 29615 consensus_queue.cc:1035] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:11.480260 29615 consensus_queue.cc:1035] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:11.496179 28758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:11.496451 28758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:11.499782 28758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: Sending DeleteTablet for 3 replicas of tablet c69ef78dc7584a878e5b63a071b5a2b0
I20260809 18:57:11.500669 29443 tablet_service.cc:1514] Processing DeleteTablet for tablet c69ef78dc7584a878e5b63a071b5a2b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:11 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:36640
I20260809 18:57:11.500699 28994 tablet_service.cc:1514] Processing DeleteTablet for tablet c69ef78dc7584a878e5b63a071b5a2b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:11 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:33820
I20260809 18:57:11.500945 29643 tablet_replica.cc:330] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: stopping tablet replica
I20260809 18:57:11.501071 29641 tablet_replica.cc:330] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: stopping tablet replica
I20260809 18:57:11.501291 29641 raft_consensus.cc:2229] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:11.501513 29219 tablet_service.cc:1514] Processing DeleteTablet for tablet c69ef78dc7584a878e5b63a071b5a2b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:11 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:40352
I20260809 18:57:11.501840 29647 tablet_replica.cc:330] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: stopping tablet replica
I20260809 18:57:11.502041 29647 raft_consensus.cc:2229] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:11.502285 29647 raft_consensus.cc:2258] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:11.503000 28757 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 18:57:11.503399 29647 ts_tablet_manager.cc:1905] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 18:57:11.503633 28757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:11.505264 29641 raft_consensus.cc:2258] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:11.506464 29641 ts_tablet_manager.cc:1905] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:11.509769 29643 raft_consensus.cc:2229] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:11.510445 29643 pending_rounds.cc:62] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Trying to abort 2 pending ops.
I20260809 18:57:11.510619 29643 pending_rounds.cc:68] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316692301731762176 op_type: WRITE_OP write_request { tablet_id: "c69ef78dc7584a878e5b63a071b5a2b0" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\263\235\343\323\006\"8\n\ntest-admin\022*\n 6ecdc76677e24546b52d125e48b0e3aa\020\001\030\001 \001(\001" signature: "<redacted>""\217s\313\350n\344\212J\277\3257`({W\312\275L\247\314BY\332\224\366\024\376\221Ty\0034\361\275\305B\206\261\316\363\212M\274!\362\301\370F`\212\244kagz\350\233\'\207\016\366\356=\035" signing_key_seq_num: 0 } } request_id { client_id: "745b69b217ce43f2b6f10fd1a9783008" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260809 18:57:11.511116 28994 tablet_service.cc:1467] Processing CreateTablet for tablet 4452aa6c044a46f1bd6092e1922c6c34 (DEFAULT_TABLE table=test-table [id=2f844196da274ed0a7de4a79015db7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:11.511333 29643 pending_rounds.cc:68] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316692301450825728 op_type: NO_OP noop_request { }
I20260809 18:57:11.511493 28994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4452aa6c044a46f1bd6092e1922c6c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:11.511476 29643 raft_consensus.cc:2866] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260809 18:57:11.511607 29643 raft_consensus.cc:2258] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:11.512428 29219 tablet_service.cc:1467] Processing CreateTablet for tablet 4452aa6c044a46f1bd6092e1922c6c34 (DEFAULT_TABLE table=test-table [id=2f844196da274ed0a7de4a79015db7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:11.512827 29219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4452aa6c044a46f1bd6092e1922c6c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:11.512984 29443 tablet_service.cc:1467] Processing CreateTablet for tablet 4452aa6c044a46f1bd6092e1922c6c34 (DEFAULT_TABLE table=test-table [id=2f844196da274ed0a7de4a79015db7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:11.513411 29443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4452aa6c044a46f1bd6092e1922c6c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:11.519183 29604 tablet_bootstrap.cc:492] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: Bootstrap starting.
I20260809 18:57:11.520761 29604 tablet_bootstrap.cc:654] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:11.520816 29641 ts_tablet_manager.cc:1918] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:11.520929 29641 log.cc:1196] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/c69ef78dc7584a878e5b63a071b5a2b0
I20260809 18:57:11.521386 29641 ts_tablet_manager.cc:1939] T c69ef78dc7584a878e5b63a071b5a2b0 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting consensus metadata
I20260809 18:57:11.522459 28737 catalog_manager.cc:4841] TS a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027): tablet c69ef78dc7584a878e5b63a071b5a2b0 (table test-table [id=6ecdc76677e24546b52d125e48b0e3aa]) successfully deleted
I20260809 18:57:11.522686 29605 tablet_bootstrap.cc:492] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: Bootstrap starting.
I20260809 18:57:11.524329 29605 tablet_bootstrap.cc:654] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:11.526338 29647 ts_tablet_manager.cc:1918] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:11.526466 29647 log.cc:1196] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/c69ef78dc7584a878e5b63a071b5a2b0
I20260809 18:57:11.526908 29647 ts_tablet_manager.cc:1939] T c69ef78dc7584a878e5b63a071b5a2b0 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting consensus metadata
I20260809 18:57:11.527973 28737 catalog_manager.cc:4841] TS 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247): tablet c69ef78dc7584a878e5b63a071b5a2b0 (table test-table [id=6ecdc76677e24546b52d125e48b0e3aa]) successfully deleted
I20260809 18:57:11.528364 29611 tablet_bootstrap.cc:492] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: Bootstrap starting.
I20260809 18:57:11.530120 29611 tablet_bootstrap.cc:654] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:11.531054 29643 ts_tablet_manager.cc:1905] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:11.531437 29605 tablet_bootstrap.cc:492] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: No bootstrap required, opened a new log
I20260809 18:57:11.531635 29605 ts_tablet_manager.cc:1397] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260809 18:57:11.532579 29605 raft_consensus.cc:348] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.532883 29605 raft_consensus.cc:374] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:11.532984 29605 raft_consensus.cc:729] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aeaef52f416409998e8dbed78e87a7a, State: Initialized, Role: FOLLOWER
I20260809 18:57:11.534385 29605 consensus_queue.cc:260] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.534986 29605 ts_tablet_manager.cc:1428] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:11.537849 29643 ts_tablet_manager.cc:1918] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:11.538074 29643 log.cc:1196] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/c69ef78dc7584a878e5b63a071b5a2b0
I20260809 18:57:11.538617 29643 ts_tablet_manager.cc:1939] T c69ef78dc7584a878e5b63a071b5a2b0 P 7aeaef52f416409998e8dbed78e87a7a: Deleting consensus metadata
I20260809 18:57:11.539343 29611 tablet_bootstrap.cc:492] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: No bootstrap required, opened a new log
I20260809 18:57:11.539525 29611 ts_tablet_manager.cc:1397] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260809 18:57:11.539989 28734 catalog_manager.cc:4841] TS 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643): tablet c69ef78dc7584a878e5b63a071b5a2b0 (table test-table [id=6ecdc76677e24546b52d125e48b0e3aa]) successfully deleted
I20260809 18:57:11.540323 29611 raft_consensus.cc:348] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.540612 29611 raft_consensus.cc:374] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:11.540692 29611 raft_consensus.cc:729] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a33b3ec87e4c42bd97a8033d0db17e16, State: Initialized, Role: FOLLOWER
I20260809 18:57:11.540928 29611 consensus_queue.cc:260] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.541399 29611 ts_tablet_manager.cc:1428] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:57:11.542346 29604 tablet_bootstrap.cc:492] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: No bootstrap required, opened a new log
I20260809 18:57:11.542508 29604 ts_tablet_manager.cc:1397] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.008s
I20260809 18:57:11.543116 29604 raft_consensus.cc:348] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.543361 29604 raft_consensus.cc:374] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:11.543439 29604 raft_consensus.cc:729] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ce79d38c4b43b6923b30094c2f37b4, State: Initialized, Role: FOLLOWER
I20260809 18:57:11.543653 29604 consensus_queue.cc:260] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.544117 29604 ts_tablet_manager.cc:1428] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 18:57:11.654227 29613 raft_consensus.cc:482] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:11.654475 29613 raft_consensus.cc:504] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.656032 29613 leader_election.cc:288] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027), 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:11.662472 29734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.656275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:33685 (local address 127.16.188.193:42027)
0809 18:57:11.656481 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.656488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.657066 (+ 578us) server_negotiation.cc:407] Connection header received
0809 18:57:11.657405 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.657410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.657500 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.657567 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:11.658251 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.658950 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.660674 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.661585 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.661739 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.661817 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.662094 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.662218 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 18:57:11.662516 29750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.656182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:42027 (local address 127.16.188.194:33685)
0809 18:57:11.656957 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.656977 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.657205 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.657759 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.657774 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.657794 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:11.658060 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.658070 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.659088 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.659092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.660523 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.660536 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.661788 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.661794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.661948 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.661973 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 18:57:11.662053 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:57:11.662175 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":452,"threads_started":1}
I20260809 18:57:11.663125 29751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.656340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43643 (local address 127.16.188.194:53997)
0809 18:57:11.657494 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.657510 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.657601 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.658042 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.658048 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.658077 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:11.658477 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.658488 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.659537 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.659554 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.661141 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.661156 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.662364 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.662371 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.662521 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.662565 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 18:57:11.662670 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 18:57:11.662796 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1028,"thread_start_us":798,"threads_started":1}
I20260809 18:57:11.663141 29754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.656503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:53997 (local address 127.16.188.195:43643)
0809 18:57:11.657713 (+ 1210us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.657718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.657736 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:57:11.657802 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.657806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.657864 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.657968 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:11.658657 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.659377 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.661289 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.662131 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.662288 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.662373 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.662720 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.662882 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1110,"thread_start_us":990,"threads_started":1}
I20260809 18:57:11.663256 29029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4452aa6c044a46f1bd6092e1922c6c34" candidate_uuid: "39ce79d38c4b43b6923b30094c2f37b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" is_pre_election: true
I20260809 18:57:11.663574 29029 raft_consensus.cc:2454] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39ce79d38c4b43b6923b30094c2f37b4 in term 0.
I20260809 18:57:11.663869 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4452aa6c044a46f1bd6092e1922c6c34" candidate_uuid: "39ce79d38c4b43b6923b30094c2f37b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeaef52f416409998e8dbed78e87a7a" is_pre_election: true
I20260809 18:57:11.664136 29479 raft_consensus.cc:2454] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39ce79d38c4b43b6923b30094c2f37b4 in term 0.
I20260809 18:57:11.664147 29151 leader_election.cc:302] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39ce79d38c4b43b6923b30094c2f37b4, a33b3ec87e4c42bd97a8033d0db17e16; no voters:
I20260809 18:57:11.664583 29613 raft_consensus.cc:2781] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:11.664695 29613 raft_consensus.cc:482] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:11.664778 29613 raft_consensus.cc:3037] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:11.667032 29613 raft_consensus.cc:504] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.667750 29613 leader_election.cc:288] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [CANDIDATE]: Term 1 election: Requested vote from peers a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027), 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643)
I20260809 18:57:11.668107 29029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4452aa6c044a46f1bd6092e1922c6c34" candidate_uuid: "39ce79d38c4b43b6923b30094c2f37b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a33b3ec87e4c42bd97a8033d0db17e16"
I20260809 18:57:11.668277 29029 raft_consensus.cc:3037] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:11.668208 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4452aa6c044a46f1bd6092e1922c6c34" candidate_uuid: "39ce79d38c4b43b6923b30094c2f37b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeaef52f416409998e8dbed78e87a7a"
I20260809 18:57:11.668412 29479 raft_consensus.cc:3037] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:11.670252 29029 raft_consensus.cc:2454] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39ce79d38c4b43b6923b30094c2f37b4 in term 1.
I20260809 18:57:11.670606 29479 raft_consensus.cc:2454] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39ce79d38c4b43b6923b30094c2f37b4 in term 1.
I20260809 18:57:11.670606 29151 leader_election.cc:302] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39ce79d38c4b43b6923b30094c2f37b4, a33b3ec87e4c42bd97a8033d0db17e16; no voters:
I20260809 18:57:11.670895 29613 raft_consensus.cc:2781] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:11.671284 29613 raft_consensus.cc:686] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 LEADER]: Becoming Leader. State: Replica: 39ce79d38c4b43b6923b30094c2f37b4, State: Running, Role: LEADER
I20260809 18:57:11.671618 29613 consensus_queue.cc:237] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } }
I20260809 18:57:11.674934 28757 catalog_manager.cc:5495] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194). New cstate: current_term: 1 leader_uuid: "39ce79d38c4b43b6923b30094c2f37b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39ce79d38c4b43b6923b30094c2f37b4" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 35247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:11.695425 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.689973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40366 (local address 127.16.188.194:35247)
0809 18:57:11.690453 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.690457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.690474 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:57:11.690549 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.690552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.690617 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.690751 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:11.691169 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.691930 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.693243 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.693651 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.693757 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.694219 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:11.694810 (+ 591us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:11.694939 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.695039 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.695114 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":246,"threads_started":1}
I20260809 18:57:11.708549 29734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.704235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:54301 (local address 127.16.188.193:42027)
0809 18:57:11.704371 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.704375 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.704672 (+ 297us) server_negotiation.cc:407] Connection header received
0809 18:57:11.704810 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.704813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.704876 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.704945 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:11.705356 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.706047 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.707251 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.707640 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.707732 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.708063 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:11.708151 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:11.708205 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.708293 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.708353 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:57:11.708654 29773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.704030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:42027 (local address 127.16.188.194:54301)
0809 18:57:11.704588 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.704611 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.704717 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.704956 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.704959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.704967 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:11.705233 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.705242 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.706141 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.706144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.707153 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.707165 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.707773 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.707777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.707882 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.707935 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:11.708212 (+ 277us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:11.708219 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 18:57:11.708269 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 18:57:11.708356 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":268,"threads_started":1}
I20260809 18:57:11.716162 29479 raft_consensus.cc:1261] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Refusing update from remote peer 39ce79d38c4b43b6923b30094c2f37b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:11.716238 29029 raft_consensus.cc:1261] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Refusing update from remote peer 39ce79d38c4b43b6923b30094c2f37b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:11.716799 29759 consensus_queue.cc:1035] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aeaef52f416409998e8dbed78e87a7a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:11.717118 29613 consensus_queue.cc:1035] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a33b3ec87e4c42bd97a8033d0db17e16" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:11.748049 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.736844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:56793 (local address 127.16.188.194:35247)
0809 18:57:11.736997 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.737003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.743586 (+ 6583us) server_negotiation.cc:407] Connection header received
0809 18:57:11.743761 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.743767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.743872 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.743958 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:11.744505 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.745314 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.746514 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.746988 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.747091 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.747436 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:11.747551 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:11.747639 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.747764 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.747826 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:57:11.748339 29780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.736773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:35247 (local address 127.16.188.193:56793)
0809 18:57:11.743476 (+ 6703us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:11.743492 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:11.743622 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:11.743987 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:11.743992 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:11.744005 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:57:11.744329 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.744342 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.745422 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.745425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.746410 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:11.746422 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.747129 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.747133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:11.747249 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.747286 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:57:11.747655 (+ 369us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:57:11.747668 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:57:11.747750 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 18:57:11.747878 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6570,"thread_start_us":6468,"threads_started":1}
I20260809 18:57:11.780475 28756 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:11.780740 28756 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:11.783726 28756 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c97c7d6ddd3487595e40716add6ceac: Sending DeleteTablet for 3 replicas of tablet 4452aa6c044a46f1bd6092e1922c6c34
I20260809 18:57:11.784482 28994 tablet_service.cc:1514] Processing DeleteTablet for tablet 4452aa6c044a46f1bd6092e1922c6c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:11 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:33820
I20260809 18:57:11.784574 29219 tablet_service.cc:1514] Processing DeleteTablet for tablet 4452aa6c044a46f1bd6092e1922c6c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:11 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:40352
I20260809 18:57:11.784889 29647 tablet_replica.cc:330] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: stopping tablet replica
I20260809 18:57:11.785032 29641 tablet_replica.cc:330] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: stopping tablet replica
I20260809 18:57:11.785138 29647 raft_consensus.cc:2229] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:11.785243 29443 tablet_service.cc:1514] Processing DeleteTablet for tablet 4452aa6c044a46f1bd6092e1922c6c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:11 UTC) from {username='oryx', principal='oryx/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:36640
I20260809 18:57:11.785495 29643 tablet_replica.cc:330] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: stopping tablet replica
I20260809 18:57:11.785648 29647 raft_consensus.cc:2258] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:11.785676 29643 raft_consensus.cc:2229] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:11.785879 29643 raft_consensus.cc:2258] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:11.786377 29641 raft_consensus.cc:2229] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:11.786556 29641 raft_consensus.cc:2258] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:11.786556 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 28876
I20260809 18:57:11.787756 29641 ts_tablet_manager.cc:1905] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:11.788861 29643 ts_tablet_manager.cc:1905] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:11.793411 29643 ts_tablet_manager.cc:1918] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:11.793563 29643 log.cc:1196] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/4452aa6c044a46f1bd6092e1922c6c34
I20260809 18:57:11.793771 29647 ts_tablet_manager.cc:1905] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:11.793965 29643 ts_tablet_manager.cc:1939] T 4452aa6c044a46f1bd6092e1922c6c34 P 7aeaef52f416409998e8dbed78e87a7a: Deleting consensus metadata
I20260809 18:57:11.794528 29641 ts_tablet_manager.cc:1918] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:11.794662 29641 log.cc:1196] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/4452aa6c044a46f1bd6092e1922c6c34
I20260809 18:57:11.794953 28734 catalog_manager.cc:4841] TS 7aeaef52f416409998e8dbed78e87a7a (127.16.188.195:43643): tablet 4452aa6c044a46f1bd6092e1922c6c34 (table test-table [id=2f844196da274ed0a7de4a79015db7e7]) successfully deleted
I20260809 18:57:11.795048 29641 ts_tablet_manager.cc:1939] T 4452aa6c044a46f1bd6092e1922c6c34 P a33b3ec87e4c42bd97a8033d0db17e16: Deleting consensus metadata
I20260809 18:57:11.796105 28737 catalog_manager.cc:4841] TS a33b3ec87e4c42bd97a8033d0db17e16 (127.16.188.193:42027): tablet 4452aa6c044a46f1bd6092e1922c6c34 (table test-table [id=2f844196da274ed0a7de4a79015db7e7]) successfully deleted
I20260809 18:57:11.798957 29647 ts_tablet_manager.cc:1918] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:57:11.799073 29647 log.cc:1196] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/4452aa6c044a46f1bd6092e1922c6c34
I20260809 18:57:11.799371 29647 ts_tablet_manager.cc:1939] T 4452aa6c044a46f1bd6092e1922c6c34 P 39ce79d38c4b43b6923b30094c2f37b4: Deleting consensus metadata
I20260809 18:57:11.800206 28737 catalog_manager.cc:4841] TS 39ce79d38c4b43b6923b30094c2f37b4 (127.16.188.194:35247): tablet 4452aa6c044a46f1bd6092e1922c6c34 (table test-table [id=2f844196da274ed0a7de4a79015db7e7]) successfully deleted
Aug 09 18:57:11 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.193@KRBTEST.COM
I20260809 18:57:11.814728 29734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:11.787820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33852 (local address 127.16.188.193:42027)
0809 18:57:11.787974 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:11.787979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:11.800705 (+ 12726us) server_negotiation.cc:407] Connection header received
0809 18:57:11.800836 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:11.800841 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:11.800933 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:11.801041 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:11.802257 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.802937 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.804128 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:11.804514 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:11.804632 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:11.808354 (+ 3722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:11.808371 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:11.808393 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:11.808435 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:11.812106 (+ 3671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:11.812742 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:11.812752 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:11.812755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:11.812914 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:11.813265 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:11.813271 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:11.813274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:11.813713 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:11.814020 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:11.814187 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 18:57:11.814408 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 18:57:11.815387 29104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:11.961922 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 28876
I20260809 18:57:12.006342 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 29119
Aug 09 18:57:12 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.194@KRBTEST.COM
I20260809 18:57:12.022833 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:12.007081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40374 (local address 127.16.188.194:35247)
0809 18:57:12.007272 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:12.007278 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:12.007299 (+ 21us) server_negotiation.cc:407] Connection header received
0809 18:57:12.007459 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:12.007465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:12.007551 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:12.007696 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:12.008808 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.010024 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.011327 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.011975 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.012103 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:12.016236 (+ 4133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:12.016249 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:12.016270 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:12.016340 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:12.020046 (+ 3706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:12.020639 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:12.020648 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:12.020652 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:12.020828 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:12.021262 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:12.021267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:12.021270 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:12.021729 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:12.022028 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:12.022213 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 18:57:12.022428 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 18:57:12.023564 29319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:12.150607 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 29119
I20260809 18:57:12.182423 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 29330
Aug 09 18:57:12 dist-test-slave-266d krb5kdc[28683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.188.195@KRBTEST.COM
I20260809 18:57:12.196943 29786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:12.183186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36658 (local address 127.16.188.195:43643)
0809 18:57:12.183659 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:12.183663 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:12.183680 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:57:12.183736 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:12.183740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:12.183804 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:12.183893 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:12.185281 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.186083 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.187265 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:12.187647 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:12.187739 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:12.191837 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:12.191853 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:12.191870 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:12.191904 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:12.194647 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:12.195197 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:12.195204 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:12.195206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:12.195335 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:12.195627 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:12.195630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:12.195632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:12.195962 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:12.196180 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:12.196438 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 18:57:12.196603 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":245,"threads_started":1}
I20260809 18:57:12.197695 29550 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:12.319732 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 29330
I20260809 18:57:12.349485 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 28707
I20260809 18:57:12.350708 28826 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:12.464543 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 28707
2026-08-09T18:57:12Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (5892 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:12 dist-test-slave-266d krb5kdc[29793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:12 dist-test-slave-266d krb5kdc[29793](info): set up 2 sockets
Aug 09 18:57:12 dist-test-slave-266d krb5kdc[29793](info): commencing operation
krb5kdc: starting...
W20260809 18:57:13.676496 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:57:13 dist-test-slave-266d krb5kdc[29793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:57:13.904361 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:34429
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:36391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:34429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:14.227087 29811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:14.227401 29811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:14.227552 29811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:14.234903 29811 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:14.235020 29811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:14.235105 29811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:14.235191 29811 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:14.235265 29811 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:14.245262 29811 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:36391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:34429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:34429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:14.246587 29811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:14.247922 29811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:14.259732 29818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:14.259765 29819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:14.260258 29821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:14.260706 29811 server_base.cc:1034] running on GCE node
I20260809 18:57:14.261466 29811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:14.262846 29811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:14.264029 29811 hybrid_clock.cc:648] HybridClock initialized: now 1786301834263979 us; error 45 us; skew 500 ppm
I20260809 18:57:14.264343 29811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T18:57:14Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1856 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:14 dist-test-slave-266d krb5kdc[29832](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:14 dist-test-slave-266d krb5kdc[29832](info): set up 2 sockets
Aug 09 18:57:14 dist-test-slave-266d krb5kdc[29832](info): commencing operation
krb5kdc: starting...
W20260809 18:57:15.561780 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.003s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:57:15 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:57:15.778621 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:39539
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:39539
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:16.097604 29853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:16.097872 29853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:16.097997 29853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:16.104907 29853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:16.105005 29853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:16.105062 29853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:16.105157 29853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:16.105208 29853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:16.114637 29853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:39539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:39539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:16.115877 29853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:16.117080 29853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:16.128111 29861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:16.128150 29868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:16.128173 29863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:16.129256 29853 server_base.cc:1034] running on GCE node
I20260809 18:57:16.129956 29853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:16.131227 29853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:16.132433 29853 hybrid_clock.cc:648] HybridClock initialized: now 1786301836132382 us; error 34 us; skew 500 ppm
I20260809 18:57:16.132737 29853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:16 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301836, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:16.140038 29853 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:57:16.141418 29853 webserver.cc:460] Webserver started at http://127.16.188.254:34441/ using document root <none> and password file <none>
I20260809 18:57:16.142024 29853 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:16.142118 29853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:16.142365 29853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:16.145126 29853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "78a20af07eaf4d199d01fca9c6ac1486"
format_stamp: "Formatted at 2026-08-09 18:57:16 on dist-test-slave-266d"
server_key: "e697fc9330dc8b971b4d7337fbf7fb32"
server_key_iv: "eea31556429993787aea0026a62aeecc"
server_key_version: "encryptionkey@0"
I20260809 18:57:16.145818 29853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "78a20af07eaf4d199d01fca9c6ac1486"
format_stamp: "Formatted at 2026-08-09 18:57:16 on dist-test-slave-266d"
server_key: "e697fc9330dc8b971b4d7337fbf7fb32"
server_key_iv: "eea31556429993787aea0026a62aeecc"
server_key_version: "encryptionkey@0"
I20260809 18:57:16.150604 29853 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 18:57:16.153817 29883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:16.155005 29853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:16.155155 29853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "78a20af07eaf4d199d01fca9c6ac1486"
format_stamp: "Formatted at 2026-08-09 18:57:16 on dist-test-slave-266d"
server_key: "e697fc9330dc8b971b4d7337fbf7fb32"
server_key_iv: "eea31556429993787aea0026a62aeecc"
server_key_version: "encryptionkey@0"
I20260809 18:57:16.155326 29853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:16.181638 29853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:16.185413 29853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:16.185673 29853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:16.202497 29853 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:39539
I20260809 18:57:16.202518 29969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:39539 every 8 connection(s)
I20260809 18:57:16.203801 29853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:16.207374 29970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:16.208379 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 29853
I20260809 18:57:16.208577 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:57:16.209276 17139 external_mini_cluster.cc:1428] Setting key ccbdd6b91af6a1bd3167591dd1ddd118
I20260809 18:57:16.221069 29970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Bootstrap starting.
Aug 09 18:57:16 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:57:16.224836 29970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:16.225907 29970 log.cc:824] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:16.228884 29970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: No bootstrap required, opened a new log
I20260809 18:57:16.232479 29976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:16.211175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41604 (local address 127.16.188.254:39539)
0809 18:57:16.211954 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:16.211965 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:16.212007 (+ 42us) server_negotiation.cc:407] Connection header received
0809 18:57:16.213914 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:16.213935 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:16.214315 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:16.214609 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:16.216410 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.217743 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.219457 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.220092 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.220209 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.224757 (+ 4548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:16.224768 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:16.224782 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:16.224815 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:16.228147 (+ 3332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:16.228765 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:16.228772 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:16.228780 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:16.229008 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:16.229394 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:16.229399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:16.229402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:16.230112 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:16.230407 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:16.230740 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 18:57:16.231191 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":341,"threads_started":1}
I20260809 18:57:16.237562 29970 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } }
I20260809 18:57:16.238010 29970 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:16.238111 29970 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a20af07eaf4d199d01fca9c6ac1486, State: Initialized, Role: FOLLOWER
I20260809 18:57:16.238639 29970 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } }
I20260809 18:57:16.238854 29970 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:16.238981 29970 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:16.239130 29970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:16.241230 29970 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } }
I20260809 18:57:16.241691 29970 leader_election.cc:302] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78a20af07eaf4d199d01fca9c6ac1486; no voters:
I20260809 18:57:16.242204 29970 leader_election.cc:288] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:16.242317 29978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:16.242909 29978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 1 LEADER]: Becoming Leader. State: Replica: 78a20af07eaf4d199d01fca9c6ac1486, State: Running, Role: LEADER
I20260809 18:57:16.243403 29978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } }
I20260809 18:57:16.244232 29970 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:16.246155 29984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78a20af07eaf4d199d01fca9c6ac1486. Latest consensus state: current_term: 1 leader_uuid: "78a20af07eaf4d199d01fca9c6ac1486" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } } }
I20260809 18:57:16.246675 29984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:16.246187 29980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78a20af07eaf4d199d01fca9c6ac1486" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } } }
I20260809 18:57:16.247035 29980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:16.247830 29992 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:16.252626 29992 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:16.262032 29992 catalog_manager.cc:1347] Generated new cluster ID: faac986d67c64a76bdd609dea6d68820
I20260809 18:57:16.262140 29992 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:16.278085 29992 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:16.279752 29992 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:16.289315 29992 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Generated new TSK 0
I20260809 18:57:16.290247 29992 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:57:16.360981 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39539
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:16.685793 30018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:16.686076 30018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:16.686216 30018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:16.693320 30018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:16.693429 30018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:16.693588 30018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:57:16.702793 30018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:16.703972 30018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:16.705252 30018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:16.717470 30026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:16.717545 30027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:16.717509 30030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:16.718303 30018 server_base.cc:1034] running on GCE node
I20260809 18:57:16.718825 30018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:16.719653 30018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:16.720839 30018 hybrid_clock.cc:648] HybridClock initialized: now 1786301836720794 us; error 40 us; skew 500 ppm
I20260809 18:57:16.721148 30018 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:16 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301836, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:16.724160 30018 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:57:16.725534 30018 webserver.cc:460] Webserver started at http://127.16.188.193:46101/ using document root <none> and password file <none>
I20260809 18:57:16.726159 30018 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:16.726266 30018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:16.726539 30018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:16.729291 30018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "ab21488949e34f0d92246e7428a5376b"
format_stamp: "Formatted at 2026-08-09 18:57:16 on dist-test-slave-266d"
server_key: "9e4e673623d25459fc83170b5e05bc77"
server_key_iv: "fafa3f7ae98f252b2efac034f749961b"
server_key_version: "encryptionkey@0"
I20260809 18:57:16.730022 30018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "ab21488949e34f0d92246e7428a5376b"
format_stamp: "Formatted at 2026-08-09 18:57:16 on dist-test-slave-266d"
server_key: "9e4e673623d25459fc83170b5e05bc77"
server_key_iv: "fafa3f7ae98f252b2efac034f749961b"
server_key_version: "encryptionkey@0"
I20260809 18:57:16.734776 30018 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 18:57:16.737921 30045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:16.739075 30018 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:57:16.739238 30018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "ab21488949e34f0d92246e7428a5376b"
format_stamp: "Formatted at 2026-08-09 18:57:16 on dist-test-slave-266d"
server_key: "9e4e673623d25459fc83170b5e05bc77"
server_key_iv: "fafa3f7ae98f252b2efac034f749961b"
server_key_version: "encryptionkey@0"
I20260809 18:57:16.739399 30018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:16.768080 30018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:16.771806 30018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:16.772054 30018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:16.772946 30018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:16.774243 30018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:16.774319 30018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:16.774434 30018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:16.774495 30018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:16.803911 30018 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:43973
I20260809 18:57:16.803949 30224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:43973 every 8 connection(s)
I20260809 18:57:16.805153 30018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:16.814633 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 30018
I20260809 18:57:16.814867 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:16.815521 17139 external_mini_cluster.cc:1428] Setting key b4644d1c09f87e73d6a93d21742f965d
Aug 09 18:57:16 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301836, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:57:16.823571 30228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:16.807497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:48249 (local address 127.16.188.254:39539)
0809 18:57:16.807949 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:16.807955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:16.808865 (+ 910us) server_negotiation.cc:407] Connection header received
0809 18:57:16.810584 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:16.810589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:16.810661 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:16.810756 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:16.812078 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.812768 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.814218 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.814629 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.814742 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.818244 (+ 3502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:16.818249 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:16.818252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:16.818283 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:16.820629 (+ 2346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:16.821374 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:16.821378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:16.821380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:16.821505 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:16.821911 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:16.821915 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:16.821917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:16.822172 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:16.822315 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:16.822980 (+ 665us) server_negotiation.cc:299] Negotiation successful
0809 18:57:16.823219 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":214,"threads_started":1}
I20260809 18:57:16.824424 30229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:16.808054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:48249)
0809 18:57:16.808711 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:16.808747 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:16.810355 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:16.810930 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:16.810938 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:16.811422 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:16.811953 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:16.811969 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.812883 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.812886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:16.814098 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:16.814111 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:16.814866 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:16.814874 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:16.815115 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:16.815817 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:16.815839 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:16.818042 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:16.820786 (+ 2744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:16.820796 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:16.820811 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:16.821261 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:16.821611 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:16.821617 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:16.821621 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:16.821800 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:16.822290 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:16.822298 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:16.822624 (+ 326us) client_negotiation.cc:769] Sending connection context
0809 18:57:16.822838 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 18:57:16.823318 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":267,"threads_started":1}
I20260809 18:57:16.825930 30225 heartbeater.cc:347] Connected to a master server at 127.16.188.254:39539
I20260809 18:57:16.826197 30225 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:16.826853 30225 heartbeater.cc:511] Master 127.16.188.254:39539 requested a full tablet report, sending...
I20260809 18:57:16.828776 29916 ts_manager.cc:194] Registered new tserver with Master: ab21488949e34f0d92246e7428a5376b (127.16.188.193:43973)
I20260809 18:57:16.830206 29916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:48249
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:57:16.868162 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39539
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:17.188411 30233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:17.188678 30233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:17.188781 30233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:17.195660 30233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:17.195757 30233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:17.195871 30233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:57:17.205020 30233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:17.206162 30233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:17.207383 30233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:17.219709 30254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:17.219733 30245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:17.220182 30246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:17.220340 30233 server_base.cc:1034] running on GCE node
I20260809 18:57:17.220983 30233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:17.221918 30233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:17.223131 30233 hybrid_clock.cc:648] HybridClock initialized: now 1786301837223076 us; error 39 us; skew 500 ppm
I20260809 18:57:17.223443 30233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:17 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301837, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:17.226680 30233 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:57:17.228070 30233 webserver.cc:460] Webserver started at http://127.16.188.194:41371/ using document root <none> and password file <none>
I20260809 18:57:17.228717 30233 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:17.228826 30233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:17.229144 30233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:17.232034 30233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "05378123ed2e4f9c930cbd92fea03ee5"
format_stamp: "Formatted at 2026-08-09 18:57:17 on dist-test-slave-266d"
server_key: "81d537a3a7daac16015cd51eeea274ab"
server_key_iv: "9975878362f75bd31cc4083eeff5e39e"
server_key_version: "encryptionkey@0"
I20260809 18:57:17.232810 30233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "05378123ed2e4f9c930cbd92fea03ee5"
format_stamp: "Formatted at 2026-08-09 18:57:17 on dist-test-slave-266d"
server_key: "81d537a3a7daac16015cd51eeea274ab"
server_key_iv: "9975878362f75bd31cc4083eeff5e39e"
server_key_version: "encryptionkey@0"
I20260809 18:57:17.238137 30233 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:57:17.241603 30263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:17.242933 30233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 18:57:17.243105 30233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "05378123ed2e4f9c930cbd92fea03ee5"
format_stamp: "Formatted at 2026-08-09 18:57:17 on dist-test-slave-266d"
server_key: "81d537a3a7daac16015cd51eeea274ab"
server_key_iv: "9975878362f75bd31cc4083eeff5e39e"
server_key_version: "encryptionkey@0"
I20260809 18:57:17.243335 30233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:17.264573 30233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:17.268952 30233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:17.269272 30233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:17.270256 30233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:17.271592 30233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:17.271674 30233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:17.271808 30233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:17.271870 30233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:17.302311 30233 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:41409
I20260809 18:57:17.302353 30438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:41409 every 8 connection(s)
I20260809 18:57:17.303548 30233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:17.308848 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 30233
I20260809 18:57:17.309046 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:17.309513 17139 external_mini_cluster.cc:1428] Setting key abff1d898df0863c2b76ff34c4885e81
Aug 09 18:57:17 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301837, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:57:17.322083 30228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:17.305990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:37513 (local address 127.16.188.254:39539)
0809 18:57:17.306167 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:17.306171 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:17.307361 (+ 1190us) server_negotiation.cc:407] Connection header received
0809 18:57:17.309151 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:17.309157 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:17.309238 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:17.309328 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:17.310836 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.311638 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.313121 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.313535 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.313643 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.316934 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:17.316939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:17.316942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:17.316982 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:17.319326 (+ 2344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:17.319967 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:17.319971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:17.319974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:17.320101 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:17.320490 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:17.320495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:17.320498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:17.320740 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:17.320865 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:17.321527 (+ 662us) server_negotiation.cc:299] Negotiation successful
0809 18:57:17.321743 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":64}
I20260809 18:57:17.322933 30443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:17.306452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:37513)
0809 18:57:17.307202 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:17.307244 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:17.308881 (+ 1637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:17.309548 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:17.309556 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:17.310043 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:17.310674 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.310695 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.311777 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.311781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.312975 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.312988 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.313744 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.313752 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.313957 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.314559 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:17.314585 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:17.316722 (+ 2137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:17.319450 (+ 2728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:17.319458 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:17.319472 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:17.319860 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:17.320212 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:17.320215 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:17.320217 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:17.320389 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:17.320871 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:17.320879 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:17.321192 (+ 313us) client_negotiation.cc:769] Sending connection context
0809 18:57:17.321421 (+ 229us) client_negotiation.cc:240] Negotiation successful
0809 18:57:17.321893 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":309,"threads_started":1}
I20260809 18:57:17.324306 30439 heartbeater.cc:347] Connected to a master server at 127.16.188.254:39539
I20260809 18:57:17.324563 30439 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:17.325347 30439 heartbeater.cc:511] Master 127.16.188.254:39539 requested a full tablet report, sending...
I20260809 18:57:17.326797 29916 ts_manager.cc:194] Registered new tserver with Master: 05378123ed2e4f9c930cbd92fea03ee5 (127.16.188.194:41409)
I20260809 18:57:17.327847 29916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:37513
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:57:17.364085 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39539
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:17.680083 30446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:17.680375 30446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:17.680500 30446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:17.687703 30446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:17.687844 30446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:17.688014 30446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:57:17.697899 30446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:17.699216 30446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:17.700553 30446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:17.713780 30453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:17.713733 30454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:17.713572 30456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:17.714639 30446 server_base.cc:1034] running on GCE node
I20260809 18:57:17.715204 30446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:17.716076 30446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:17.717270 30446 hybrid_clock.cc:648] HybridClock initialized: now 1786301837717217 us; error 48 us; skew 500 ppm
I20260809 18:57:17.717549 30446 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:17 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301837, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:17.720474 30446 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:57:17.721822 30446 webserver.cc:460] Webserver started at http://127.16.188.195:45767/ using document root <none> and password file <none>
I20260809 18:57:17.722405 30446 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:17.722500 30446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:17.722754 30446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:17.725487 30446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "fad128db712b44b687d33e42673dcd52"
format_stamp: "Formatted at 2026-08-09 18:57:17 on dist-test-slave-266d"
server_key: "5e434e5e62beeea9039a805b9f25cf8e"
server_key_iv: "593dd4527825e2e43c70d6e114b96c77"
server_key_version: "encryptionkey@0"
I20260809 18:57:17.726307 30446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "fad128db712b44b687d33e42673dcd52"
format_stamp: "Formatted at 2026-08-09 18:57:17 on dist-test-slave-266d"
server_key: "5e434e5e62beeea9039a805b9f25cf8e"
server_key_iv: "593dd4527825e2e43c70d6e114b96c77"
server_key_version: "encryptionkey@0"
I20260809 18:57:17.731125 30446 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 18:57:17.734279 30466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:17.735534 30446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:17.735728 30446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "fad128db712b44b687d33e42673dcd52"
format_stamp: "Formatted at 2026-08-09 18:57:17 on dist-test-slave-266d"
server_key: "5e434e5e62beeea9039a805b9f25cf8e"
server_key_iv: "593dd4527825e2e43c70d6e114b96c77"
server_key_version: "encryptionkey@0"
I20260809 18:57:17.735925 30446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:17.759970 30446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:17.764714 30446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:17.765039 30446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:17.766104 30446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:17.767551 30446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:17.767663 30446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:17.767805 30446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:17.767874 30446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:17.801735 30446 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:36573
I20260809 18:57:17.801801 30635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:36573 every 8 connection(s)
I20260809 18:57:17.803110 30446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:17.806293 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 30446
I20260809 18:57:17.806512 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:17.807030 17139 external_mini_cluster.cc:1428] Setting key 746964744894c48329b0aa71b50fe5a4
Aug 09 18:57:17 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301837, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:57:17.823832 30228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:17.806202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:40799 (local address 127.16.188.254:39539)
0809 18:57:17.806423 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:17.806430 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:17.807831 (+ 1401us) server_negotiation.cc:407] Connection header received
0809 18:57:17.810199 (+ 2368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:17.810204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:17.810317 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:17.810403 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:17.811883 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.812608 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.814196 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.814587 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.814674 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.818105 (+ 3431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:17.818110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:17.818113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:17.818143 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:17.820563 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:17.821463 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:17.821469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:17.821473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:17.821636 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:17.822118 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:17.822122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:17.822124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:17.822464 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:17.822625 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:17.823340 (+ 715us) server_negotiation.cc:299] Negotiation successful
0809 18:57:17.823567 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 18:57:17.824702 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:17.806686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:40799)
0809 18:57:17.807651 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:17.807699 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:17.809904 (+ 2205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:17.810645 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:17.810653 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:17.811182 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:17.811744 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.811761 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.812742 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.812746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.814079 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:17.814093 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.814759 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.814764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:17.814965 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.815673 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:17.815698 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:17.817914 (+ 2216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:17.820711 (+ 2797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:17.820720 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:17.820735 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:17.821343 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:17.821750 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:17.821755 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:17.821758 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:17.821998 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:17.822598 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:17.822606 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:17.822971 (+ 365us) client_negotiation.cc:769] Sending connection context
0809 18:57:17.823211 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 18:57:17.823591 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":470,"threads_started":1}
I20260809 18:57:17.826092 30636 heartbeater.cc:347] Connected to a master server at 127.16.188.254:39539
I20260809 18:57:17.826378 30636 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:17.827055 30636 heartbeater.cc:511] Master 127.16.188.254:39539 requested a full tablet report, sending...
I20260809 18:57:17.828457 29916 ts_manager.cc:194] Registered new tserver with Master: fad128db712b44b687d33e42673dcd52 (127.16.188.195:36573)
I20260809 18:57:17.829452 29916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:40799
I20260809 18:57:17.832866 30225 heartbeater.cc:503] Master 127.16.188.254:39539 was elected leader, sending a full tablet report...
I20260809 18:57:17.835047 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab.
Entry for principal oryx/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab.
WARNING: no policy specified for oryx/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab.
Entry for principal oryx/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab.
WARNING: no policy specified for oryx/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab.
Entry for principal oryx/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab.
I20260809 18:57:17.974900 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 30018
Aug 09 18:57:17 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:57:17.990108 30651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:17.975961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59978 (local address 127.16.188.193:43973)
0809 18:57:17.976590 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:17.976597 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:17.976634 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:57:17.976698 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:17.976705 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:17.976923 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:17.977055 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:17.978379 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.979666 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.980884 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:17.981539 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:17.981655 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:17.985323 (+ 3668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:17.985334 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:17.985348 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:17.985387 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:17.987865 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:17.988438 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:17.988444 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:17.988446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:17.988559 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:17.988840 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:17.988843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:17.988845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:17.989211 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:17.989442 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:17.989634 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 18:57:17.989825 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":333,"threads_started":1}
I20260809 18:57:17.991326 30220 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:18.072053 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 30018
I20260809 18:57:18.094923 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 30233
Aug 09 18:57:18 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:57:18.109563 30656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:18.095742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36288 (local address 127.16.188.194:41409)
0809 18:57:18.096248 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:18.096254 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:18.096288 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:57:18.096374 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:18.096380 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:18.096580 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:18.096710 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:18.097918 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.098893 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.100039 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.100569 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.100660 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:18.104506 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:18.104518 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:18.104531 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:18.104564 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:18.107163 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:18.107761 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:18.107767 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:18.107770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:18.107883 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:18.108134 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:18.108137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:18.108138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:18.108469 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:18.108691 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:18.108928 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 18:57:18.109269 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":237,"threads_started":1}
I20260809 18:57:18.110761 30429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:18.190894 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 30233
I20260809 18:57:18.214844 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 30446
Aug 09 18:57:18 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:57:18.230562 30658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:18.215807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53898 (local address 127.16.188.195:36573)
0809 18:57:18.216416 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:18.216422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:18.216451 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:57:18.216511 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:18.216518 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:18.216722 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:18.216870 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:18.218294 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.219318 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.220566 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:18.221161 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:18.221279 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:18.225377 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:18.225388 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:18.225402 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:18.225440 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:18.227919 (+ 2479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:18.228541 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:18.228548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:18.228550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:18.228674 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:18.229020 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:18.229024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:18.229026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:18.229402 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:18.229711 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:18.229974 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 18:57:18.230230 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":293,"threads_started":1}
I20260809 18:57:18.231853 30629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:18.316913 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 30446
I20260809 18:57:18.338006 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 29853
I20260809 18:57:18.339150 29963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:18.439256 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 29853
I20260809 18:57:18.463886 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:39539
--webserver_interface=127.16.188.254
--webserver_port=34441
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:39539
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:18.788919 30663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:18.789206 30663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:18.789340 30663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:18.797272 30663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:18.797364 30663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:18.797432 30663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:18.797506 30663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:18.797564 30663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:18.806843 30663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:39539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:39539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=34441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:18.808036 30663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:18.809345 30663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:18.820576 30669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:18.820475 30670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:18.820550 30672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:18.821404 30663 server_base.cc:1034] running on GCE node
I20260809 18:57:18.822154 30663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:18.823489 30663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:18.824690 30663 hybrid_clock.cc:648] HybridClock initialized: now 1786301838824640 us; error 43 us; skew 500 ppm
I20260809 18:57:18.825026 30663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:18 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301838, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:18.827924 30663 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:57:18.829447 30663 webserver.cc:460] Webserver started at http://127.16.188.254:34441/ using document root <none> and password file <none>
I20260809 18:57:18.830058 30663 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:18.830178 30663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:18.835280 30663 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 18:57:18.838012 30681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:18.839309 30663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 18:57:18.839461 30663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "78a20af07eaf4d199d01fca9c6ac1486"
format_stamp: "Formatted at 2026-08-09 18:57:16 on dist-test-slave-266d"
server_key: "e697fc9330dc8b971b4d7337fbf7fb32"
server_key_iv: "eea31556429993787aea0026a62aeecc"
server_key_version: "encryptionkey@0"
I20260809 18:57:18.840358 30663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:18.852330 30663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:18.856143 30663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:18.856386 30663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:18.873368 30663 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:39539
I20260809 18:57:18.873391 30761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:39539 every 8 connection(s)
I20260809 18:57:18.874758 30663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:18.876636 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 30663
I20260809 18:57:18.877599 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:43973
--local_ip_for_outbound_sockets=127.16.188.193
--tserver_master_addrs=127.16.188.254:39539
--webserver_port=46101
--webserver_interface=127.16.188.193
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.188.193
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:57:18.883217 30762 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:57:18.887380 30762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Bootstrap starting.
I20260809 18:57:18.905925 30762 log.cc:824] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:18.914804 30762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:57:18.915289 30762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Bootstrap complete.
I20260809 18:57:18.923903 30762 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } }
I20260809 18:57:18.924677 30762 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a20af07eaf4d199d01fca9c6ac1486, State: Initialized, Role: FOLLOWER
I20260809 18:57:18.925318 30762 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } }
I20260809 18:57:18.925539 30762 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:18.925645 30762 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:18.925808 30762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:57:18.929414 30762 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } }
I20260809 18:57:18.929880 30762 leader_election.cc:302] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78a20af07eaf4d199d01fca9c6ac1486; no voters:
I20260809 18:57:18.930454 30762 leader_election.cc:288] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:57:18.930590 30769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:57:18.931651 30769 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [term 2 LEADER]: Becoming Leader. State: Replica: 78a20af07eaf4d199d01fca9c6ac1486, State: Running, Role: LEADER
I20260809 18:57:18.932240 30769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } }
I20260809 18:57:18.932575 30762 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:18.934883 30772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78a20af07eaf4d199d01fca9c6ac1486. Latest consensus state: current_term: 2 leader_uuid: "78a20af07eaf4d199d01fca9c6ac1486" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } } }
I20260809 18:57:18.935262 30772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:18.935732 30771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "78a20af07eaf4d199d01fca9c6ac1486" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a20af07eaf4d199d01fca9c6ac1486" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39539 } } }
I20260809 18:57:18.936013 30771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:18.948712 30778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:18.954361 30778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:18.955834 30778 catalog_manager.cc:1259] Loaded cluster ID: faac986d67c64a76bdd609dea6d68820
I20260809 18:57:18.956001 30778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:18.960076 30778 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:18.961004 30794 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:57:18.961719 30778 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 78a20af07eaf4d199d01fca9c6ac1486: Loaded TSK: 0
I20260809 18:57:18.962805 30778 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:57:19.220453 30766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:19.220759 30766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:19.220898 30766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:19.228264 30766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:19.228403 30766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:19.228556 30766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:57:19.238637 30766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.193.keytab
--principal=oryx/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:43973
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=46101
--tserver_master_addrs=127.16.188.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:19.239974 30766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:19.241341 30766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:19.255910 30803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:19.255937 30801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:19.256228 30805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:19.256911 30766 server_base.cc:1034] running on GCE node
I20260809 18:57:19.257575 30766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:19.258580 30766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:19.259807 30766 hybrid_clock.cc:648] HybridClock initialized: now 1786301839259753 us; error 42 us; skew 500 ppm
I20260809 18:57:19.260123 30766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301839, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:19.263236 30766 init.cc:377] Logged in from keytab as oryx/127.16.188.193@KRBTEST.COM (short username oryx)
I20260809 18:57:19.264722 30766 webserver.cc:460] Webserver started at http://127.16.188.193:46101/ using document root <none> and password file <none>
I20260809 18:57:19.265463 30766 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:19.265594 30766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:19.271143 30766 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 18:57:19.273909 30816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:19.275259 30766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:19.275411 30766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "ab21488949e34f0d92246e7428a5376b"
format_stamp: "Formatted at 2026-08-09 18:57:16 on dist-test-slave-266d"
server_key: "9e4e673623d25459fc83170b5e05bc77"
server_key_iv: "fafa3f7ae98f252b2efac034f749961b"
server_key_version: "encryptionkey@0"
I20260809 18:57:19.276352 30766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:19.292901 30766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:19.296983 30766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:19.297271 30766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:19.298240 30766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:19.299541 30766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:19.299633 30766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:19.299742 30766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:19.299816 30766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:19.330035 30766 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:43973
I20260809 18:57:19.330099 30978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:43973 every 8 connection(s)
I20260809 18:57:19.331444 30766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:19.333900 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 30766
I20260809 18:57:19.334648 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:41409
--local_ip_for_outbound_sockets=127.16.188.194
--tserver_master_addrs=127.16.188.254:39539
--webserver_port=41371
--webserver_interface=127.16.188.194
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.188.194
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:19.349792 30983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.334628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:51257)
0809 18:57:19.335652 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.335696 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.337454 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.338728 (+ 1274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.338738 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.339320 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.339832 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.339849 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.341440 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.341444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.342630 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.342642 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.343728 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.343736 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.343994 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.344667 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.344695 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.348496 (+ 3801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":601,"threads_started":1}
W20260809 18:57:19.350045 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.334370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:51257 (local address 127.16.188.254:39539)
0809 18:57:19.335167 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.335182 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.335821 (+ 639us) server_negotiation.cc:407] Connection header received
0809 18:57:19.337931 (+ 2110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.337943 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.338249 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.338558 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.340020 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.341286 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.342771 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.343501 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.343688 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.348882 (+ 5194us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:51257: BlockingRecv error: recv got EOF from 127.16.188.193:51257 (error 108)
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":330,"threads_started":1}
W20260809 18:57:19.350692 30979 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:39539 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.188.254:39539: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:19.359021 30983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.351290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:39445)
0809 18:57:19.351466 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.351485 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.351588 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.351890 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.351894 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.352225 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.352365 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.352373 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.353383 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.353389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.354272 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.354284 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.354957 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.354963 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.355126 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.355718 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.355734 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.358713 (+ 2979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 18:57:19.359467 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.351369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:39445 (local address 127.16.188.254:39539)
0809 18:57:19.351516 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.351521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.351540 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:57:19.351709 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.351715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.351774 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.351852 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.352501 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.353254 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.354409 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.354820 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.354928 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.358941 (+ 4013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:39445: BlockingRecv error: recv got EOF from 127.16.188.193:39445 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:19.367601 30983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.359733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:59605)
0809 18:57:19.359949 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.359965 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.360044 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.360612 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.360618 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.360912 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.361063 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.361074 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.362095 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.362101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.363031 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.363043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.363777 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.363783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.363964 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.364522 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.364539 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.367281 (+ 2742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120}
W20260809 18:57:19.367894 30979 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:57:19.367933 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.360155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:59605 (local address 127.16.188.254:39539)
0809 18:57:19.360315 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.360319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.360334 (+ 15us) server_negotiation.cc:407] Connection header received
0809 18:57:19.360375 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.360379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.360459 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.360550 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.361238 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.361947 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.363191 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.363624 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.363738 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.367499 (+ 3761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:59605: BlockingRecv error: recv got EOF from 127.16.188.193:59605 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 18:57:19.662140 30984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:19.662411 30984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:19.662547 30984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:19.669479 30984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:19.669587 30984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:19.669771 30984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:57:19.679091 30984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.194.keytab
--principal=oryx/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:41409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=41371
--tserver_master_addrs=127.16.188.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:19.680378 30984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:19.681620 30984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:19.693873 30993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:19.693843 30997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:19.694416 30992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:19.694579 30984 server_base.cc:1034] running on GCE node
I20260809 18:57:19.695165 30984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:19.696045 30984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:19.697243 30984 hybrid_clock.cc:648] HybridClock initialized: now 1786301839697195 us; error 37 us; skew 500 ppm
I20260809 18:57:19.697523 30984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301839, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:19.700382 30984 init.cc:377] Logged in from keytab as oryx/127.16.188.194@KRBTEST.COM (short username oryx)
I20260809 18:57:19.701746 30984 webserver.cc:460] Webserver started at http://127.16.188.194:41371/ using document root <none> and password file <none>
I20260809 18:57:19.702374 30984 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:19.702499 30984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:19.707578 30984 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 18:57:19.710062 31006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:19.711233 30984 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 18:57:19.711386 30984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "05378123ed2e4f9c930cbd92fea03ee5"
format_stamp: "Formatted at 2026-08-09 18:57:17 on dist-test-slave-266d"
server_key: "81d537a3a7daac16015cd51eeea274ab"
server_key_iv: "9975878362f75bd31cc4083eeff5e39e"
server_key_version: "encryptionkey@0"
I20260809 18:57:19.712291 30984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:19.722191 30984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:19.725633 30984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:19.725869 30984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:19.726727 30984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:19.727958 30984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:19.728060 30984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:19.728178 30984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:19.728248 30984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:19.757875 30984 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:41409
I20260809 18:57:19.757942 31209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:41409 every 8 connection(s)
I20260809 18:57:19.759276 30984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:19.760970 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 30984
I20260809 18:57:19.761603 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:36573
--local_ip_for_outbound_sockets=127.16.188.195
--tserver_master_addrs=127.16.188.254:39539
--webserver_port=45767
--webserver_interface=127.16.188.195
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.188.195
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:57:19.775978 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.761845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:36073 (local address 127.16.188.254:39539)
0809 18:57:19.762044 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.762050 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.763286 (+ 1236us) server_negotiation.cc:407] Connection header received
0809 18:57:19.765548 (+ 2262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.765553 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.765651 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.765738 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.767532 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.768229 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.770304 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.770847 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.770961 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.775722 (+ 4761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:36073: BlockingRecv error: recv got EOF from 127.16.188.194:36073 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 18:57:19.776569 31214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.762302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:36073)
0809 18:57:19.763085 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.763142 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.765241 (+ 2099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.765984 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.765994 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.766651 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.767374 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.767399 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.768377 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.768382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.770132 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.770145 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.771062 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.771068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.771327 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.772060 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.772082 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.775517 (+ 3435us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":298,"threads_started":1}
W20260809 18:57:19.777148 31210 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:39539 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.188.254:39539: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:19.785465 31214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.777677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:53529)
0809 18:57:19.777832 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.777850 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.777941 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.778311 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.778313 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.778584 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.778705 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.778711 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.779983 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.779987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.780922 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.780933 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.781805 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.781808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.781926 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.782483 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.782499 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.785195 (+ 2696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 18:57:19.785511 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.777847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:53529 (local address 127.16.188.254:39539)
0809 18:57:19.778036 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.778041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.778058 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:57:19.778113 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.778117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.778193 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.778303 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.778836 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.779865 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.781052 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.781680 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.781795 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.785345 (+ 3550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:53529: BlockingRecv error: recv got EOF from 127.16.188.194:53529 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:19 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:19.793008 31214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:19.786160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:44547)
0809 18:57:19.786334 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:19.786352 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:19.786452 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:19.786718 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:19.786722 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:19.786994 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:19.787125 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.787133 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.788047 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.788051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.788914 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:19.788924 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.789646 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.789651 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:19.789808 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.790345 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:19.790361 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:19.792741 (+ 2380us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 18:57:19.793180 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:19.786210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:44547 (local address 127.16.188.254:39539)
0809 18:57:19.786351 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:19.786356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:19.786411 (+ 55us) server_negotiation.cc:407] Connection header received
0809 18:57:19.786554 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:19.786559 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:19.786612 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:19.786684 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:19.787250 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.787923 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.789038 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:19.789516 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:19.789624 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:19.792953 (+ 3329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:44547: BlockingRecv error: recv got EOF from 127.16.188.194:44547 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 18:57:19.793432 31210 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:57:20.090901 31216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:20.091180 31216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:20.091315 31216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:20.098443 31216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:20.098551 31216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:20.098709 31216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:57:20.108222 31216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/krb5kdc/oryx_127.16.188.195.keytab
--principal=oryx/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:36573
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=45767
--tserver_master_addrs=127.16.188.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:20.109562 31216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:20.110824 31216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:20.123296 31232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:20.123348 31229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:20.123422 31226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:20.124430 31216 server_base.cc:1034] running on GCE node
I20260809 18:57:20.124969 31216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:20.125859 31216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:20.127038 31216 hybrid_clock.cc:648] HybridClock initialized: now 1786301840126990 us; error 48 us; skew 500 ppm
I20260809 18:57:20.127324 31216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301840, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:20.130267 31216 init.cc:377] Logged in from keytab as oryx/127.16.188.195@KRBTEST.COM (short username oryx)
I20260809 18:57:20.131615 31216 webserver.cc:460] Webserver started at http://127.16.188.195:45767/ using document root <none> and password file <none>
I20260809 18:57:20.132253 31216 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:20.132380 31216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:20.137434 31216 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:20.139879 31243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:20.141070 31216 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:57:20.141278 31216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "fad128db712b44b687d33e42673dcd52"
format_stamp: "Formatted at 2026-08-09 18:57:17 on dist-test-slave-266d"
server_key: "5e434e5e62beeea9039a805b9f25cf8e"
server_key_iv: "593dd4527825e2e43c70d6e114b96c77"
server_key_version: "encryptionkey@0"
I20260809 18:57:20.142172 31216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:20.172394 31216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:20.176119 31216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:20.176379 31216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:20.177361 31216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:20.178665 31216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:20.178752 31216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:20.178862 31216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:20.178939 31216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:20.210152 31216 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:36573
I20260809 18:57:20.210203 31410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:36573 every 8 connection(s)
I20260809 18:57:20.211616 31216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:20.219123 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 31216
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:57:20.227964 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:20.214172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:45671 (local address 127.16.188.254:39539)
0809 18:57:20.214356 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.214360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.215559 (+ 1199us) server_negotiation.cc:407] Connection header received
0809 18:57:20.217636 (+ 2077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.217642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.217725 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.217821 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.219401 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.220292 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.222033 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.222439 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.222555 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.227751 (+ 5196us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:45671: BlockingRecv error: recv got EOF from 127.16.188.195:45671 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 18:57:20.228863 31414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.214663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:45671)
0809 18:57:20.215394 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:20.215437 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:20.217347 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:20.218075 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:20.218084 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:20.218583 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:20.219176 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.219195 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.220513 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.220520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.221889 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.221903 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.222673 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.222681 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.222895 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.223543 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:20.223565 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:20.227610 (+ 4045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":294,"threads_started":1}
W20260809 18:57:20.229810 31411 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:39539 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.188.254:39539: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
I20260809 18:57:20.235842 31417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.220221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39016 (local address 127.16.188.254:39539)
0809 18:57:20.220887 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.220892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.220909 (+ 17us) server_negotiation.cc:407] Connection header received
0809 18:57:20.220947 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.220950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.221000 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.221084 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.222588 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.223461 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.224704 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.225198 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.225330 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.228486 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:20.228494 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:20.228512 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:20.228549 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:20.232015 (+ 3466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:20.233196 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:20.233206 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:20.233215 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:20.233476 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:20.233830 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:20.233835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:20.233838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:20.234366 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:20.234645 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:20.235084 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 18:57:20.235442 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":425,"threads_started":1}
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:20.238689 31414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.230413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:46995)
0809 18:57:20.230585 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:20.230601 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:20.230685 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:20.230993 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:20.230996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:20.231326 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:20.231470 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.231478 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.232695 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.232700 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.233845 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.233861 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.234624 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.234631 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.234770 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.235328 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:20.235350 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:20.238411 (+ 3061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 18:57:20.239161 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:20.230520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:46995 (local address 127.16.188.254:39539)
0809 18:57:20.230692 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.230697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.230741 (+ 44us) server_negotiation.cc:407] Connection header received
0809 18:57:20.230800 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.230805 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.230884 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.230986 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.231607 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.232567 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.233981 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.234470 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.234608 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.238602 (+ 3994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:46995: BlockingRecv error: recv got EOF from 127.16.188.195:46995 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:20.246645 31414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.239341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:41565)
0809 18:57:20.239640 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:20.239660 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:20.239761 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:20.240046 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:20.240049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:20.240316 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:20.240454 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.240461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.241408 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.241411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.242308 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.242319 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.242911 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.242915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.243039 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.243548 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:20.243564 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:20.246404 (+ 2840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 18:57:20.246930 31411 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:57:20.247133 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:20.239628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:41565 (local address 127.16.188.254:39539)
0809 18:57:20.239842 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.239846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.239860 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:57:20.239896 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.239900 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.239948 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.240022 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.240551 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.241304 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.242410 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.242802 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.242886 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.246635 (+ 3749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:41565: BlockingRecv error: recv got EOF from 127.16.188.195:41565 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:20.376559 31418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.368490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:48289)
0809 18:57:20.369023 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:20.369039 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:20.369206 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:20.369533 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:20.369538 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:20.370033 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:20.370227 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.370236 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.371222 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.371227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.372165 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.372176 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.372946 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.372953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.373155 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.373664 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:20.373681 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:20.376330 (+ 2649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":276,"threads_started":1}
W20260809 18:57:20.376724 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:20.368567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:48289 (local address 127.16.188.254:39539)
0809 18:57:20.368744 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.368750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.369289 (+ 539us) server_negotiation.cc:407] Connection header received
0809 18:57:20.369343 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.369348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.369408 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.369485 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.370368 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.371081 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.372310 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.372772 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.372881 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.376527 (+ 3646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:48289: BlockingRecv error: recv got EOF from 127.16.188.193:48289 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:20 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:20.803382 31419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:20.793949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:48427)
0809 18:57:20.794451 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:20.794469 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:20.794592 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:20.794868 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:20.794871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:20.795364 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:20.795577 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.795588 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.796639 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.796643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.798233 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:20.798247 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.799297 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.799305 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:20.799499 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.800122 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:20.800146 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:20.803135 (+ 2989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":241,"threads_started":1}
W20260809 18:57:20.803516 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:20.794080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:48427 (local address 127.16.188.254:39539)
0809 18:57:20.794317 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:20.794323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:20.794538 (+ 215us) server_negotiation.cc:407] Connection header received
0809 18:57:20.794683 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:20.794687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:20.794746 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:20.794831 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:20.795688 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.796492 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.798385 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:20.798933 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:20.799056 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:20.803311 (+ 4255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:48427: BlockingRecv error: recv got EOF from 127.16.188.194:48427 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 18:57:21 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:21 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:21.258208 31421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:21.247423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:35787)
0809 18:57:21.247936 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:21.247952 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:21.248080 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:21.248399 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:21.248404 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:21.248974 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:21.249220 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.249232 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.250407 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.250413 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.251395 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.251408 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.252048 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.252052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.252169 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.255092 (+ 2923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:21.255110 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:21.257888 (+ 2778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":278,"threads_started":1}
W20260809 18:57:21.258315 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:21.247504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:35787 (local address 127.16.188.254:39539)
0809 18:57:21.247694 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:21.247701 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:21.248026 (+ 325us) server_negotiation.cc:407] Connection header received
0809 18:57:21.248204 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:21.248210 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:21.248276 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:21.248355 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:21.249376 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.250251 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.251512 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.251911 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.252001 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.258098 (+ 6097us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:35787: BlockingRecv error: recv got EOF from 127.16.188.195:35787 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 18:57:21 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:21 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:21.385686 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:21.377410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:47175)
0809 18:57:21.378085 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:21.378106 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:21.378251 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:21.378510 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:21.378513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:21.378908 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:21.379085 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.379094 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.380168 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.380172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.381180 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.381196 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.381903 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.381909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.382054 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.382624 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:21.382643 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:21.385353 (+ 2710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":406,"threads_started":1}
W20260809 18:57:21.385802 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:21.377475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:47175 (local address 127.16.188.254:39539)
0809 18:57:21.377671 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:21.377678 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:21.378195 (+ 517us) server_negotiation.cc:407] Connection header received
0809 18:57:21.378352 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:21.378356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:21.378420 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:21.378495 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:21.379194 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.380003 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.381336 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.381746 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.381856 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.385552 (+ 3696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:47175: BlockingRecv error: recv got EOF from 127.16.188.193:47175 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 18:57:21 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:21 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:21.812480 31424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:21.804212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:37761)
0809 18:57:21.804939 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:21.804959 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:21.805146 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:21.805506 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:21.805511 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:21.806018 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:21.806269 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.806285 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.807239 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.807242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.808136 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:21.808147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.808736 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.808740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:21.808847 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.809514 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:21.809532 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:21.812145 (+ 2613us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":487,"threads_started":1}
W20260809 18:57:21.812606 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:21.804312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:37761 (local address 127.16.188.254:39539)
0809 18:57:21.804534 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:21.804541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:21.805054 (+ 513us) server_negotiation.cc:407] Connection header received
0809 18:57:21.805273 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:21.805279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:21.805355 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:21.805448 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:21.806428 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.807140 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.808240 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:21.808630 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:21.808713 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:21.812398 (+ 3685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:37761: BlockingRecv error: recv got EOF from 127.16.188.194:37761 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 18:57:22 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:22 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:22.267377 31430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:22.259080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:58567)
0809 18:57:22.259638 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:22.259657 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:22.259794 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:22.260085 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:22.260088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:22.260490 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:22.260684 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.260694 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.261678 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.261682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.262744 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.262760 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.263506 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.263512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.263659 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.264251 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:22.264272 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:22.267129 (+ 2857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":311,"threads_started":1}
W20260809 18:57:22.267613 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:22.259189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:58567 (local address 127.16.188.254:39539)
0809 18:57:22.259359 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:22.259363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:22.259720 (+ 357us) server_negotiation.cc:407] Connection header received
0809 18:57:22.259887 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:22.259890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:22.259960 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:22.260037 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:22.260795 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.261516 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.262899 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.263346 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.263458 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.267329 (+ 3871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:58567: BlockingRecv error: recv got EOF from 127.16.188.195:58567 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 18:57:22 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:22 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:22.394557 31431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:22.386667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:46125)
0809 18:57:22.387177 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:22.387200 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:22.387325 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:22.387619 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:22.387622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:22.387970 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:22.388140 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.388148 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.389153 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.389158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.390238 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.390251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.390932 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.390937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.391129 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.391660 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:22.391676 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:22.394301 (+ 2625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":271,"threads_started":1}
W20260809 18:57:22.394687 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:22.386765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:46125 (local address 127.16.188.254:39539)
0809 18:57:22.386992 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:22.386999 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:22.387290 (+ 291us) server_negotiation.cc:407] Connection header received
0809 18:57:22.387420 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:22.387424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:22.387487 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:22.387564 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:22.388259 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.389005 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.390377 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.390776 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.390868 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.394487 (+ 3619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:46125: BlockingRecv error: recv got EOF from 127.16.188.193:46125 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 18:57:22 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:22 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:22.821632 31432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:22.813534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:43059)
0809 18:57:22.814048 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:22.814067 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:22.814193 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:22.814458 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:22.814461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:22.814806 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:22.814979 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.814989 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.815970 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.815974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.816998 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:22.817013 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.817746 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.817751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:22.817881 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.818542 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:22.818564 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:22.821371 (+ 2807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":282,"threads_started":1}
W20260809 18:57:22.821731 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:22.813616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:43059 (local address 127.16.188.254:39539)
0809 18:57:22.813777 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:22.813781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:22.814140 (+ 359us) server_negotiation.cc:407] Connection header received
0809 18:57:22.814297 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:22.814300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:22.814361 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:22.814430 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:22.815091 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.815870 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.817154 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:22.817611 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:22.817738 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:22.821548 (+ 3810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:43059: BlockingRecv error: recv got EOF from 127.16.188.194:43059 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 18:57:23 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:23 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:23.275661 31433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:23.268283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:43589)
0809 18:57:23.268734 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:23.268751 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:23.268866 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:23.269172 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:23.269176 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:23.269515 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:23.269683 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.269693 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.270594 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.270598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.271485 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.271496 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.272090 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.272094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.272217 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.272739 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:23.272756 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:23.275389 (+ 2633us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":226,"threads_started":1}
W20260809 18:57:23.275764 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:23.268333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:43589 (local address 127.16.188.254:39539)
0809 18:57:23.268524 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:23.268531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:23.268822 (+ 291us) server_negotiation.cc:407] Connection header received
0809 18:57:23.268945 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:23.268948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:23.269019 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:23.269114 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:23.269801 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.270483 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.271584 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.271991 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.272074 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.275570 (+ 3496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:43589: BlockingRecv error: recv got EOF from 127.16.188.195:43589 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 18:57:23 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:23 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:23.403077 31435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:23.395466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:58245)
0809 18:57:23.395973 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:23.395990 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:23.396112 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:23.396375 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:23.396377 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:23.396735 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:23.396896 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.396904 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.397853 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.397857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.398810 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.398820 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.399427 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.399431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.399548 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.400116 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:23.400133 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:23.402842 (+ 2709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":258,"threads_started":1}
W20260809 18:57:23.403316 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:23.395528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:58245 (local address 127.16.188.254:39539)
0809 18:57:23.395717 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:23.395721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:23.396055 (+ 334us) server_negotiation.cc:407] Connection header received
0809 18:57:23.396202 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:23.396205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:23.396267 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:23.396357 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:23.397004 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.397747 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.398926 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.399324 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.399417 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.403082 (+ 3665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:58245: BlockingRecv error: recv got EOF from 127.16.188.193:58245 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 09 18:57:23 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:23 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:23.829929 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:23.822451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:56135)
0809 18:57:23.822882 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:23.822898 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:23.823018 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:23.823264 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:23.823266 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:23.823628 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:23.823784 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.823793 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.824745 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.824750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.825752 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:23.825766 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.826362 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.826366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:23.826481 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.827035 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:23.827053 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:23.829685 (+ 2632us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":225,"threads_started":1}
W20260809 18:57:23.830053 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:23.822516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:56135 (local address 127.16.188.254:39539)
0809 18:57:23.822727 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:23.822733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:23.822970 (+ 237us) server_negotiation.cc:407] Connection header received
0809 18:57:23.823111 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:23.823114 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:23.823176 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:23.823249 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:23.823889 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.824622 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.825863 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:23.826259 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:23.826345 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:23.829864 (+ 3519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:56135: BlockingRecv error: recv got EOF from 127.16.188.194:56135 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 18:57:24 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:24 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:24.285008 31443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:24.276550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:34087)
0809 18:57:24.277133 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:24.277153 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:24.277295 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:24.277600 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:24.277603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:24.277987 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:24.278160 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.278170 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.279185 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.279191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.280293 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.280309 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.280967 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.280972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.281156 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.281786 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:24.281806 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:24.284775 (+ 2969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":305,"threads_started":1}
W20260809 18:57:24.285249 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:24.276603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:34087 (local address 127.16.188.254:39539)
0809 18:57:24.276757 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:24.276761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:24.277215 (+ 454us) server_negotiation.cc:407] Connection header received
0809 18:57:24.277392 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:24.277396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:24.277456 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:24.277535 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:24.278276 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.279029 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.280443 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.280833 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.280923 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.284982 (+ 4059us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:34087: BlockingRecv error: recv got EOF from 127.16.188.195:34087 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 18:57:24 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:24 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:24.411681 31445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:24.404009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:50381)
0809 18:57:24.404518 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:24.404535 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:24.404647 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:24.404902 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:24.404905 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:24.405339 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:24.405505 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.405514 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.406463 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.406467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.407372 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.407384 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.408011 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.408015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.408127 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.408655 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:24.408672 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:24.411343 (+ 2671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":243,"threads_started":1}
W20260809 18:57:24.411736 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:24.404087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:50381 (local address 127.16.188.254:39539)
0809 18:57:24.404282 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:24.404287 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:24.404604 (+ 317us) server_negotiation.cc:407] Connection header received
0809 18:57:24.404732 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:24.404735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:24.404795 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:24.404874 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:24.405635 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.406355 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.407480 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.407900 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.407995 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.411557 (+ 3562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:50381: BlockingRecv error: recv got EOF from 127.16.188.193:50381 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 09 18:57:24 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:24 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:24.839071 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:24.830794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:56605)
0809 18:57:24.831280 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:24.831295 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:24.831405 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:24.831665 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:24.831668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:24.832043 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:24.832208 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.832216 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.833239 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.833244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.834496 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:24.834508 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.835143 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.835147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:24.835262 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.835816 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:24.835834 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:24.838807 (+ 2973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":233,"threads_started":1}
W20260809 18:57:24.839193 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:24.830958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:56605 (local address 127.16.188.254:39539)
0809 18:57:24.831106 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:24.831111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:24.831363 (+ 252us) server_negotiation.cc:407] Connection header received
0809 18:57:24.831482 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:24.831486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:24.831544 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:24.831617 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:24.832313 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.833117 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.834636 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:24.835031 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:24.835115 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:24.838985 (+ 3870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:56605: BlockingRecv error: recv got EOF from 127.16.188.194:56605 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 18:57:25 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:25 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:25.294109 31447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:25.285968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:38859)
0809 18:57:25.286457 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:25.286473 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:25.286595 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:25.286900 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:25.286905 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:25.287325 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:25.287490 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.287500 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.288908 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.288914 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.289882 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.289895 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.290549 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.290553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.290666 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.291234 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:25.291250 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:25.293860 (+ 2610us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":234,"threads_started":1}
W20260809 18:57:25.294296 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:25.286014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:38859 (local address 127.16.188.254:39539)
0809 18:57:25.286189 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:25.286196 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:25.286554 (+ 358us) server_negotiation.cc:407] Connection header received
0809 18:57:25.286704 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:25.286709 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:25.286771 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:25.286849 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:25.287648 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.288749 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.290007 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.290438 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.290544 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.294055 (+ 3511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:38859: BlockingRecv error: recv got EOF from 127.16.188.195:38859 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 18:57:25 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:25 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:25.420658 31448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:25.412692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:54179)
0809 18:57:25.413227 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:25.413244 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:25.413356 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:25.413613 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:25.413616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:25.414003 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:25.414163 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.414172 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.415427 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.415431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.416340 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.416352 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.417154 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.417160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.417322 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.417840 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:25.417857 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:25.420361 (+ 2504us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":274,"threads_started":1}
W20260809 18:57:25.420833 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:25.412738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:54179 (local address 127.16.188.254:39539)
0809 18:57:25.412899 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:25.412904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:25.413308 (+ 404us) server_negotiation.cc:407] Connection header received
0809 18:57:25.413443 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:25.413446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:25.413506 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:25.413581 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:25.414300 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.415285 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.416542 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.416976 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.417083 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.420590 (+ 3507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:54179: BlockingRecv error: recv got EOF from 127.16.188.193:54179 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 18:57:25 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:25 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:25.849843 31450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:25.839912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:58301)
0809 18:57:25.840839 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:25.840858 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:25.840998 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:25.841341 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:25.841346 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:25.841895 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:25.842088 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.842111 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.843527 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.843533 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.844885 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:25.844905 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.845856 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.845862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:25.846045 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.846765 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:25.846790 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:25.849615 (+ 2825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":814,"thread_start_us":504,"threads_started":1}
W20260809 18:57:25.850055 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:25.840027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:58301 (local address 127.16.188.254:39539)
0809 18:57:25.840823 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:25.840829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:25.840935 (+ 106us) server_negotiation.cc:407] Connection header received
0809 18:57:25.841128 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:25.841133 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:25.841203 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:25.841286 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:25.842274 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.843359 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.845031 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:25.845692 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:25.845814 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:25.849831 (+ 4017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:58301: BlockingRecv error: recv got EOF from 127.16.188.194:58301 (error 108)
Metrics: {"server-negotiator.queue_time_us":657}
Aug 09 18:57:26 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:26 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:26.305809 31452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.294961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:43599)
0809 18:57:26.295438 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:26.295454 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:26.295564 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:26.295825 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:26.295827 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:26.296204 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:26.296380 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.296389 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.297375 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.297378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.298252 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.298262 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.298920 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.298924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.299035 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.302657 (+ 3622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:26.302675 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:26.305584 (+ 2909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":265,"threads_started":1}
W20260809 18:57:26.305964 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:26.295010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:43599 (local address 127.16.188.254:39539)
0809 18:57:26.295236 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.295243 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.295525 (+ 282us) server_negotiation.cc:407] Connection header received
0809 18:57:26.295654 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.295657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.295719 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.295798 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.296485 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.297275 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.298368 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.298807 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.298897 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.305756 (+ 6859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:43599: BlockingRecv error: recv got EOF from 127.16.188.195:43599 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 18:57:26 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:26 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:26.429572 31454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.421580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:36585)
0809 18:57:26.422097 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:26.422123 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:26.422253 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:26.422574 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:26.422579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:26.423001 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:26.423182 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.423192 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.424175 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.424179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.425140 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.425159 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.425864 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.425870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.426030 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.426535 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:26.426552 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:26.429257 (+ 2705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":222,"threads_started":1}
W20260809 18:57:26.429670 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:26.421652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:36585 (local address 127.16.188.254:39539)
0809 18:57:26.421833 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.421840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.422206 (+ 366us) server_negotiation.cc:407] Connection header received
0809 18:57:26.422364 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.422369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.422430 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.422506 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.423328 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.424035 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.425275 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.425718 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.425839 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.429499 (+ 3660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:36585: BlockingRecv error: recv got EOF from 127.16.188.193:36585 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 18:57:26 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:26 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:26.858659 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:26.850674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:36871)
0809 18:57:26.851235 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:26.851251 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:26.851367 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:26.851636 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:26.851640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:26.852061 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:26.852229 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.852238 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.853249 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.853253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.854163 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:26.854175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.854799 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.854804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:26.854916 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.855445 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:26.855462 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:26.858329 (+ 2867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":263,"threads_started":1}
W20260809 18:57:26.858754 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:26.850729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:36871 (local address 127.16.188.254:39539)
0809 18:57:26.850918 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:26.850922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:26.851315 (+ 393us) server_negotiation.cc:407] Connection header received
0809 18:57:26.851450 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:26.851453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:26.851514 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:26.851588 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:26.852347 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.853138 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.854267 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:26.854669 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:26.854753 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:26.858516 (+ 3763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:36871: BlockingRecv error: recv got EOF from 127.16.188.194:36871 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 09 18:57:27 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:27 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:27.314885 31456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.306766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:53085)
0809 18:57:27.307421 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:27.307440 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:27.307573 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:27.307853 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:27.307856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:27.308319 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:27.308505 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:27.308515 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.309574 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.309578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:27.310502 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:27.310516 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.311214 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.311220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:27.311378 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:27.311921 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:27.311939 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:27.314633 (+ 2694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":302,"threads_started":1}
W20260809 18:57:27.315033 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:27.306827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:53085 (local address 127.16.188.254:39539)
0809 18:57:27.306975 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:27.306980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:27.307508 (+ 528us) server_negotiation.cc:407] Connection header received
0809 18:57:27.307679 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:27.307683 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:27.307742 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:27.307811 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:27.308631 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.309423 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.310641 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.311054 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.311165 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:27.314846 (+ 3681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:53085: BlockingRecv error: recv got EOF from 127.16.188.195:53085 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 18:57:27 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:27 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:27.439126 31457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.430613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:51335)
0809 18:57:27.431163 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:27.431179 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:27.431313 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:27.431615 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:27.431620 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:27.432048 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:27.432201 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:27.432213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.433234 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.433240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:27.434178 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:27.434190 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.434921 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.434927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:27.435080 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:27.435630 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:27.435647 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:27.438805 (+ 3158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":285,"threads_started":1}
W20260809 18:57:27.439242 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:27.430788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:51335 (local address 127.16.188.254:39539)
0809 18:57:27.430984 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:27.430990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:27.431258 (+ 268us) server_negotiation.cc:407] Connection header received
0809 18:57:27.431427 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:27.431431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:27.431490 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:27.431566 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:27.432332 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.433053 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.434315 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.434753 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.434858 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:27.439003 (+ 4145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:51335: BlockingRecv error: recv got EOF from 127.16.188.193:51335 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 18:57:27 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:27 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:27.867944 31459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:27.859596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:39585)
0809 18:57:27.860076 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:27.860092 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:27.860215 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:27.860519 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:27.860524 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:27.860942 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:27.861130 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:27.861144 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.862282 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.862286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:27.863180 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:27.863191 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.863930 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.863936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:27.864068 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:27.864641 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:27.864665 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:27.867705 (+ 3040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":235,"threads_started":1}
W20260809 18:57:27.868098 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:27.859670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:39585 (local address 127.16.188.254:39539)
0809 18:57:27.859848 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:27.859853 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:27.860166 (+ 313us) server_negotiation.cc:407] Connection header received
0809 18:57:27.860322 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:27.860327 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:27.860390 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:27.860468 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:27.861271 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.862137 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.863318 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:27.863752 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:27.863868 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:27.867903 (+ 4035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:39585: BlockingRecv error: recv got EOF from 127.16.188.194:39585 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 18:57:28 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:28 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:28.327582 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:28.315804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:43645)
0809 18:57:28.319482 (+ 3678us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:28.319504 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:28.319641 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:28.320325 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:28.320330 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:28.320886 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:28.321120 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:28.321137 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.322231 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.322237 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:28.323157 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:28.323171 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.323910 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.323917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:28.324070 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:28.324614 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:28.324631 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:28.327346 (+ 2715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":3516,"thread_start_us":4597,"threads_started":1}
W20260809 18:57:28.327754 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:28.319297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:43645 (local address 127.16.188.254:39539)
0809 18:57:28.320016 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:28.320020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:28.320034 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:57:28.320085 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:28.320089 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:28.320168 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:28.320264 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:28.321311 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.322077 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.323298 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.323730 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.323838 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:28.327532 (+ 3694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:43645: BlockingRecv error: recv got EOF from 127.16.188.195:43645 (error 108)
Metrics: {"server-negotiator.queue_time_us":601}
Aug 09 18:57:28 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:28 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:28.447962 31461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:28.440037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:47199)
0809 18:57:28.440556 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:28.440571 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:28.440685 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:28.440961 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:28.440964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:28.441401 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:28.441572 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:28.441582 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.442542 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.442545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:28.443552 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:28.443566 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.444276 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.444281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:28.444429 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:28.444973 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:28.444993 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:28.447718 (+ 2725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":273,"threads_started":1}
W20260809 18:57:28.448122 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:28.440129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:47199 (local address 127.16.188.254:39539)
0809 18:57:28.440302 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:28.440307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:28.440664 (+ 357us) server_negotiation.cc:407] Connection header received
0809 18:57:28.440773 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:28.440777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:28.440841 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:28.440920 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:28.441693 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.442448 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.443693 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.444140 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.444237 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:28.447897 (+ 3660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:47199: BlockingRecv error: recv got EOF from 127.16.188.193:47199 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 18:57:28 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:28 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:28.876930 31463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:28.868814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:50561)
0809 18:57:28.869340 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:28.869357 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:28.869479 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:28.869743 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:28.869745 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:28.870176 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:28.870349 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:28.870359 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.871360 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.871365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:28.872307 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:28.872319 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.872917 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.872921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:28.873040 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:28.873619 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:28.873636 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:28.876592 (+ 2956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":278,"threads_started":1}
W20260809 18:57:28.877048 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:28.868893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:50561 (local address 127.16.188.254:39539)
0809 18:57:28.869138 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:28.869144 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:28.869440 (+ 296us) server_negotiation.cc:407] Connection header received
0809 18:57:28.869569 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:28.869572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:28.869636 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:28.869722 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:28.870463 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.871231 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.872412 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:28.872808 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:28.872890 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:28.876819 (+ 3929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:50561: BlockingRecv error: recv got EOF from 127.16.188.194:50561 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 18:57:29 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:29 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:29.337868 31466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.328583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:39693)
0809 18:57:29.329052 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.329069 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.329209 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.329475 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.329478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.329853 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:29.330021 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.330030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.331383 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.331389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.332879 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.332896 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.333724 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.333730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.333910 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.334478 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:29.334496 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:29.337513 (+ 3017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":237,"threads_started":1}
W20260809 18:57:29.337978 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:29.328678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:39693 (local address 127.16.188.254:39539)
0809 18:57:29.328917 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.328924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.329160 (+ 236us) server_negotiation.cc:407] Connection header received
0809 18:57:29.329294 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.329297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.329360 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.329434 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:29.330149 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.331217 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.333013 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.333563 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.333665 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.337755 (+ 4090us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:39693: BlockingRecv error: recv got EOF from 127.16.188.195:39693 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 09 18:57:29 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:29 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:29.456873 31469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.449131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:47649)
0809 18:57:29.449760 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.449787 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.449896 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.450161 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.450164 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.450532 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:29.450678 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.450686 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.451627 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.451630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.452547 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.452558 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.453192 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.453197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.453309 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.453851 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:29.453867 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:29.456560 (+ 2693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":391,"threads_started":1}
W20260809 18:57:29.457018 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:29.449189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:47649 (local address 127.16.188.254:39539)
0809 18:57:29.449395 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.449401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.449854 (+ 453us) server_negotiation.cc:407] Connection header received
0809 18:57:29.449996 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.450000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.450062 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.450132 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:29.450788 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.451523 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.452646 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.453068 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.453172 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.456787 (+ 3615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:47649: BlockingRecv error: recv got EOF from 127.16.188.193:47649 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 18:57:29 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:29 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:29.886878 31470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:29.878180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:56581)
0809 18:57:29.878721 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:29.878741 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:29.878863 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:29.879170 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:29.879173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:29.879607 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:29.879793 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.879804 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.881077 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.881083 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.882373 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:29.882389 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.883027 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.883032 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:29.883158 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.883719 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:29.883737 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:29.886625 (+ 2888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":265,"threads_started":1}
W20260809 18:57:29.886982 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:29.878270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:56581 (local address 127.16.188.254:39539)
0809 18:57:29.878454 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:29.878460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:29.878822 (+ 362us) server_negotiation.cc:407] Connection header received
0809 18:57:29.878961 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:29.878966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:29.879042 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:29.879157 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:29.879963 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.880932 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.882503 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:29.882909 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:29.883001 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:29.886791 (+ 3790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:56581: BlockingRecv error: recv got EOF from 127.16.188.194:56581 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 18:57:30 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:30 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:30.346984 31475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:30.338733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:42719)
0809 18:57:30.339219 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:30.339235 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:30.339359 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:30.339661 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:30.339666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:30.340058 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:30.340214 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:30.340224 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.341220 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.341226 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:30.342163 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:30.342175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.342974 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.342980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:30.343145 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:30.343832 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:30.343850 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:30.346636 (+ 2786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":247,"threads_started":1}
W20260809 18:57:30.347100 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:30.338912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:42719 (local address 127.16.188.254:39539)
0809 18:57:30.339147 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:30.339153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:30.339310 (+ 157us) server_negotiation.cc:407] Connection header received
0809 18:57:30.339467 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:30.339472 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:30.339538 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:30.339616 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:30.340373 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.341077 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.342303 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.342824 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.342934 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:30.346870 (+ 3936us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:42719: BlockingRecv error: recv got EOF from 127.16.188.195:42719 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 09 18:57:30 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:30 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:30.465960 31478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:30.457828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:43605)
0809 18:57:30.458473 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:30.458489 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:30.458626 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:30.458975 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:30.458979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:30.459542 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:30.459736 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:30.459745 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.460765 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.460769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:30.461806 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:30.461818 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.462506 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.462510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:30.462625 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:30.463156 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:30.463173 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:30.465724 (+ 2551us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":396,"threads_started":1}
W20260809 18:57:30.466171 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:30.457905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:43605 (local address 127.16.188.254:39539)
0809 18:57:30.458157 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:30.458166 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:30.458574 (+ 408us) server_negotiation.cc:407] Connection header received
0809 18:57:30.458747 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:30.458751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:30.458822 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:30.458925 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:30.459869 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.460660 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.461935 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.462387 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.462491 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:30.465938 (+ 3447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:43605: BlockingRecv error: recv got EOF from 127.16.188.193:43605 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 18:57:30 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:30 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:30.896399 31479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:30.887771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:52491)
0809 18:57:30.888273 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:30.888290 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:30.888421 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:30.888776 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:30.888781 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:30.889266 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:30.889458 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:30.889468 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.890552 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.890557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:30.891443 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:30.891456 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.892201 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.892207 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:30.892376 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:30.892963 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:30.892982 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:30.896029 (+ 3047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":258,"threads_started":1}
W20260809 18:57:30.896526 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:30.887865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:52491 (local address 127.16.188.254:39539)
0809 18:57:30.888069 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:30.888076 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:30.888373 (+ 297us) server_negotiation.cc:407] Connection header received
0809 18:57:30.888531 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:30.888537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:30.888631 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:30.888714 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:30.889618 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.890409 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.891609 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:30.892047 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:30.892160 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:30.896288 (+ 4128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:52491: BlockingRecv error: recv got EOF from 127.16.188.194:52491 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 18:57:31 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:31 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:31.359246 31480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:31.347897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:52253)
0809 18:57:31.348388 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:31.348404 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:31.348530 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:31.348890 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:31.348894 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:31.349367 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:31.349546 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:31.349555 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.350525 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.350531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:31.351419 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:31.351431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.352152 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.352158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:31.352326 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:31.356041 (+ 3715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:31.356060 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:31.358945 (+ 2885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":260,"threads_started":1}
W20260809 18:57:31.359387 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:31.347968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:52253 (local address 127.16.188.254:39539)
0809 18:57:31.348148 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:31.348155 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:31.348478 (+ 323us) server_negotiation.cc:407] Connection header received
0809 18:57:31.348656 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:31.348660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:31.348757 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:31.348848 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:31.349698 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.350402 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.351560 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.352000 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.352110 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:31.359159 (+ 7049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:52253: BlockingRecv error: recv got EOF from 127.16.188.195:52253 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 18:57:31 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:31 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:31.475538 31481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:31.466924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:45257)
0809 18:57:31.467490 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:31.467508 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:31.467640 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:31.467909 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:31.467912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:31.468360 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:31.468538 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:31.468548 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.469582 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.469587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:31.470631 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:31.470647 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.471489 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.471494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:31.471639 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:31.472201 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:31.472220 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:31.475295 (+ 3075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":332,"threads_started":1}
W20260809 18:57:31.475662 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:31.466947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:45257 (local address 127.16.188.254:39539)
0809 18:57:31.467129 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:31.467134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:31.467579 (+ 445us) server_negotiation.cc:407] Connection header received
0809 18:57:31.467728 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:31.467731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:31.467792 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:31.467869 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:31.468663 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.469410 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.470760 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.471366 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.471456 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:31.475457 (+ 4001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:45257: BlockingRecv error: recv got EOF from 127.16.188.193:45257 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 18:57:31 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:31 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:31.905407 31482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:31.897327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:39481)
0809 18:57:31.897814 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:31.897831 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:31.897945 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:31.898218 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:31.898221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:31.898592 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:31.898746 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:31.898755 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.899682 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.899686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:31.900577 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:31.900588 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.901319 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.901326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:31.901498 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:31.902129 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:31.902153 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:31.905040 (+ 2887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":267,"threads_started":1}
W20260809 18:57:31.905490 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:31.897387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:39481 (local address 127.16.188.254:39539)
0809 18:57:31.897635 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:31.897641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:31.897902 (+ 261us) server_negotiation.cc:407] Connection header received
0809 18:57:31.898031 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:31.898035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:31.898097 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:31.898176 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:31.898862 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.899566 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.900698 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:31.901170 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:31.901280 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:31.905283 (+ 4003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:39481: BlockingRecv error: recv got EOF from 127.16.188.194:39481 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 18:57:32 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:32 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:32.368054 31483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:32.360165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:41215)
0809 18:57:32.360613 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:32.360630 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:32.360756 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:32.361009 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:32.361012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:32.361412 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:32.361568 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:32.361576 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.362500 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.362503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:32.363424 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:32.363437 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.364089 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.364094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:32.364244 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:32.364833 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:32.364851 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:32.367771 (+ 2920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":245,"threads_started":1}
W20260809 18:57:32.368278 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:32.360208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:41215 (local address 127.16.188.254:39539)
0809 18:57:32.360427 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:32.360434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:32.360702 (+ 268us) server_negotiation.cc:407] Connection header received
0809 18:57:32.360843 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:32.360846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:32.360907 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:32.360982 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:32.361677 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.362393 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.363539 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.363958 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.364054 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:32.368017 (+ 3963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:41215: BlockingRecv error: recv got EOF from 127.16.188.195:41215 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 18:57:32 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:32 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:32.484479 31485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:32.476405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:37497)
0809 18:57:32.476894 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:32.476910 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:32.477040 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:32.477370 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:32.477375 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:32.477779 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:32.477938 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:32.477947 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.478952 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.478956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:32.479933 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:32.479945 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.480724 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.480730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:32.480877 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:32.481408 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:32.481425 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:32.484138 (+ 2713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":239,"threads_started":1}
W20260809 18:57:32.484633 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:32.476455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:37497 (local address 127.16.188.254:39539)
0809 18:57:32.476642 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:32.476648 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:32.476989 (+ 341us) server_negotiation.cc:407] Connection header received
0809 18:57:32.477164 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:32.477169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:32.477234 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:32.477322 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:32.478071 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.478822 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.480068 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.480545 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.480649 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:32.484308 (+ 3659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:37497: BlockingRecv error: recv got EOF from 127.16.188.193:37497 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 18:57:32 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:32 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:32.914314 31488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:32.906345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:39129)
0809 18:57:32.906875 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:32.906891 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:32.907017 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:32.907332 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:32.907337 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:32.907762 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:32.907922 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:32.907932 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.908950 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.908954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:32.909923 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:32.909936 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.910661 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.910667 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:32.910817 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:32.911384 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:32.911402 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:32.913977 (+ 2575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":257,"threads_started":1}
W20260809 18:57:32.914415 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:32.906536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:39129 (local address 127.16.188.254:39539)
0809 18:57:32.906744 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:32.906750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:32.906966 (+ 216us) server_negotiation.cc:407] Connection header received
0809 18:57:32.907123 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:32.907128 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:32.907191 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:32.907269 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:32.908066 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.908815 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.910061 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:32.910493 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:32.910598 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:32.914193 (+ 3595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:39129: BlockingRecv error: recv got EOF from 127.16.188.194:39129 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 18:57:33 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:33 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:33.377324 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:33.369203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:50171)
0809 18:57:33.369684 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:33.369700 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:33.369840 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:33.370150 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:33.370154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:33.370572 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:33.370733 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:33.370744 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.371805 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.371809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:33.372814 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:33.372827 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.373636 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.373642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:33.373799 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:33.374322 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:33.374339 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:33.376973 (+ 2634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":235,"threads_started":1}
W20260809 18:57:33.377439 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:33.369243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:50171 (local address 127.16.188.254:39539)
0809 18:57:33.369418 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:33.369424 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:33.369781 (+ 357us) server_negotiation.cc:407] Connection header received
0809 18:57:33.369953 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:33.369958 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:33.370028 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:33.370107 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:33.370887 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.371662 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.372942 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.373459 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.373570 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:33.377215 (+ 3645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:50171: BlockingRecv error: recv got EOF from 127.16.188.195:50171 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 18:57:33 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:33 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:33.493177 31490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:33.485434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:56789)
0809 18:57:33.485883 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:33.485899 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:33.486012 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:33.486278 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:33.486281 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:33.486649 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:33.486823 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:33.486832 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.487818 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.487821 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:33.488708 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:33.488718 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.489542 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.489547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:33.489670 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:33.490313 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:33.490337 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:33.492893 (+ 2556us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":237,"threads_started":1}
W20260809 18:57:33.493323 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:33.485518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:56789 (local address 127.16.188.254:39539)
0809 18:57:33.485814 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:33.485819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:33.485966 (+ 147us) server_negotiation.cc:407] Connection header received
0809 18:57:33.486106 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:33.486109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:33.486170 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:33.486240 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:33.486928 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.487710 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.488818 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.489408 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.489536 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:33.493074 (+ 3538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:56789: BlockingRecv error: recv got EOF from 127.16.188.193:56789 (error 108)
Metrics: {"server-negotiator.queue_time_us":149}
Aug 09 18:57:33 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:33 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:33.923173 31492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:33.915303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:37411)
0809 18:57:33.915781 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:33.915799 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:33.915928 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:33.916272 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:33.916276 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:33.916715 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:33.916900 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:33.916911 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.917973 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.917979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:33.918918 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:33.918931 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.919638 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.919643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:33.919798 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:33.920327 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:33.920345 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:33.922951 (+ 2606us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":222,"threads_started":1}
W20260809 18:57:33.923321 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:33.915371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:37411 (local address 127.16.188.254:39539)
0809 18:57:33.915548 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:33.915554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:33.915875 (+ 321us) server_negotiation.cc:407] Connection header received
0809 18:57:33.916035 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:33.916040 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:33.916114 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:33.916195 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:33.917044 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.917828 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.919054 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:33.919492 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:33.919601 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:33.923132 (+ 3531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:37411: BlockingRecv error: recv got EOF from 127.16.188.194:37411 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 18:57:34 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:34 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.195@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:34.386075 31493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:34.378275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.195:56553)
0809 18:57:34.378701 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:34.378717 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:34.378831 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:34.379111 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:34.379114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:34.379517 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:34.379715 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:34.379725 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.380735 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.380739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:34.381662 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:34.381675 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.382286 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.382290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:34.382401 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:34.382937 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:34.382954 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:34.385825 (+ 2871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":215,"threads_started":1}
W20260809 18:57:34.386220 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:34.378337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:56553 (local address 127.16.188.254:39539)
0809 18:57:34.378557 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:34.378563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:34.378791 (+ 228us) server_negotiation.cc:407] Connection header received
0809 18:57:34.378918 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:34.378921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:34.379005 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:34.379078 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:34.379851 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.380608 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.381773 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.382177 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.382265 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:34.386010 (+ 3745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.195:56553: BlockingRecv error: recv got EOF from 127.16.188.195:56553 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 18:57:34 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:34 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.193@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:34.501829 31495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:34.494199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.193:57649)
0809 18:57:34.494708 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:34.494724 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:34.494834 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:34.495095 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:34.495098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:34.495507 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:34.495711 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:34.495721 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.496689 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.496692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:34.497634 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:34.497646 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.498286 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.498289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:34.498398 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:34.498930 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:34.498946 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:34.501583 (+ 2637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":256,"threads_started":1}
W20260809 18:57:34.501976 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:34.494266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:57649 (local address 127.16.188.254:39539)
0809 18:57:34.494446 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:34.494450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:34.494788 (+ 338us) server_negotiation.cc:407] Connection header received
0809 18:57:34.494918 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:34.494921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:34.494981 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:34.495056 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:34.495833 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.496582 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.497739 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.498177 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.498264 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:34.501761 (+ 3497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.193:57649: BlockingRecv error: recv got EOF from 127.16.188.193:57649 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 18:57:34 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:57:34 dist-test-slave-266d krb5kdc[29832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.188.194@KRBTEST.COM for oryx/127.16.188.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:57:34.933382 31496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:34.924467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39539 (local address 127.16.188.194:55919)
0809 18:57:34.925230 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:34.925250 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:34.925402 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:34.925936 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:34.925942 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:34.926443 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:34.926633 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:34.926643 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.927669 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.927673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:34.928569 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:34.928581 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.929344 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.929349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:34.929500 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:34.930079 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:34.930098 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:34.933007 (+ 2909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.188.254:39539: Server oryx/127.16.188.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":454,"threads_started":1}
W20260809 18:57:34.933445 30982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:34.924563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:55919 (local address 127.16.188.254:39539)
0809 18:57:34.924762 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:34.924769 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:34.925348 (+ 579us) server_negotiation.cc:407] Connection header received
0809 18:57:34.925538 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:34.925543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:34.925617 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:34.925700 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:34.926773 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.927513 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.928709 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:34.929213 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:34.929322 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:34.933220 (+ 3898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.188.194:55919: BlockingRecv error: recv got EOF from 127.16.188.194:55919 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 18:57:35.227197 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 30766
I20260809 18:57:35.239223 31498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:35.228286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52216 (local address 127.16.188.193:43973)
0809 18:57:35.228817 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:35.228825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:35.228852 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:57:35.228911 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:35.228918 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:35.229177 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:35.229347 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:35.230742 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:35.231706 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:35.233045 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:35.233624 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:35.233772 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:35.236196 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:35.236204 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:35.236219 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:35.236258 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:35.238630 (+ 2372us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.188.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 18:57:35.238925 (+ 295us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52216: Request ticket server kudu/127.16.188.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":249,"threads_started":1}
W20260809 18:57:35.239348 31498 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52216: Request ticket server kudu/127.16.188.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 18:57:35.239413 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 30766: Not authorized: Client connection negotiation failed: client connection to 127.16.188.193:43973: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.188.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 18:57:35.239630 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 30766
I20260809 18:57:35.265524 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 30984
I20260809 18:57:35.277554 31499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:35.266532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45178 (local address 127.16.188.194:41409)
0809 18:57:35.267121 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:35.267128 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:35.267159 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:57:35.267220 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:35.267227 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:35.267439 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:35.267605 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:35.268962 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:35.270069 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:35.271369 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:35.271919 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:35.272038 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:35.274651 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:35.274660 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:35.274674 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:35.274708 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:35.276894 (+ 2186us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.188.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 18:57:35.277231 (+ 337us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45178: Request ticket server kudu/127.16.188.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":263,"threads_started":1}
W20260809 18:57:35.277583 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 30984: Not authorized: Client connection negotiation failed: client connection to 127.16.188.194:41409: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.188.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 18:57:35.277658 31499 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45178: Request ticket server kudu/127.16.188.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 18:57:35.277738 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 30984
I20260809 18:57:35.302618 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 31216
I20260809 18:57:35.313876 31500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:35.303594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.16.188.195:36573)
0809 18:57:35.304131 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:35.304138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:35.304164 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:57:35.304228 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:35.304235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:35.304451 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:35.304604 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:35.305929 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:35.306881 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:35.307958 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:35.308464 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:35.308555 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:35.310922 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:35.310930 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:35.310943 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:35.310978 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:35.313351 (+ 2373us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.188.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 18:57:35.313595 (+ 244us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53770: Request ticket server kudu/127.16.188.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":265,"threads_started":1}
W20260809 18:57:35.313982 31500 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53770: Request ticket server kudu/127.16.188.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 18:57:35.313984 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 31216: Not authorized: Client connection negotiation failed: client connection to 127.16.188.195:36573: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.188.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 18:57:35.314163 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 31216
I20260809 18:57:35.338246 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 30663
I20260809 18:57:35.339569 30754 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:35.455000 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 30663
2026-08-09T18:57:35Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21135 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T18:57:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:35Z Disabled control of system clock
I20260809 18:57:35.542515 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:38067
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:39989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:38067
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 18:57:35.867090 31509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:35.867357 31509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:35.867475 31509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:35.874555 31509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:35.874672 31509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:35.874738 31509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:35.874817 31509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:35.874884 31509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:35.883773 31509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:38067
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:38067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:35.884982 31509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:35.886744 31509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:35.898049 31518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:35.898149 31516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:35.898120 31522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:35.898654 31509 server_base.cc:1034] running on GCE node
I20260809 18:57:35.899418 31509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:35.900713 31509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:35.901902 31509 hybrid_clock.cc:648] HybridClock initialized: now 1786301855901850 us; error 40 us; skew 500 ppm
I20260809 18:57:35.902225 31509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:57:35.904253 31509 webserver.cc:460] Webserver started at http://127.16.188.254:37623/ using document root <none> and password file <none>
I20260809 18:57:35.904893 31509 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:35.904990 31509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:35.905330 31509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:35.908049 31509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "d5061e9226c54e0e841f6345f7b22944"
format_stamp: "Formatted at 2026-08-09 18:57:35 on dist-test-slave-266d"
server_key: "e13338cdb98676ffbc3db994a8c5f182"
server_key_iv: "cf4abd609f368e04e07076809054008e"
server_key_version: "encryptionkey@0"
I20260809 18:57:35.908783 31509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "d5061e9226c54e0e841f6345f7b22944"
format_stamp: "Formatted at 2026-08-09 18:57:35 on dist-test-slave-266d"
server_key: "e13338cdb98676ffbc3db994a8c5f182"
server_key_iv: "cf4abd609f368e04e07076809054008e"
server_key_version: "encryptionkey@0"
I20260809 18:57:35.913498 31509 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 18:57:35.916577 31530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:35.917847 31509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:57:35.918001 31509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "d5061e9226c54e0e841f6345f7b22944"
format_stamp: "Formatted at 2026-08-09 18:57:35 on dist-test-slave-266d"
server_key: "e13338cdb98676ffbc3db994a8c5f182"
server_key_iv: "cf4abd609f368e04e07076809054008e"
server_key_version: "encryptionkey@0"
I20260809 18:57:35.918195 31509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:35.936771 31509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:35.937608 31509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:35.937865 31509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:35.954097 31509 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:38067
I20260809 18:57:35.954128 31608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:38067 every 8 connection(s)
I20260809 18:57:35.955361 31509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:35.958917 31609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:35.963290 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 31509
I20260809 18:57:35.963500 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:57:35.964304 17139 external_mini_cluster.cc:1428] Setting key cb1912e793ac5cd5961793be82efdba8
I20260809 18:57:35.970131 31609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944: Bootstrap starting.
I20260809 18:57:35.973451 31609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:35.974614 31609 log.cc:824] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:35.977660 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:35.966280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47918 (local address 127.16.188.254:38067)
0809 18:57:35.967172 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:35.967181 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:35.967228 (+ 47us) server_negotiation.cc:407] Connection header received
0809 18:57:35.968863 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:35.968885 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:35.969348 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:35.969637 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:35.970318 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:35.971552 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:35.973325 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:35.973992 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:35.974122 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:35.975380 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:35.975390 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:35.975408 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:35.976079 (+ 671us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:35.976180 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:35.976203 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:35.976293 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:35.976493 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 18:57:35.976760 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":298,"threads_started":1}
I20260809 18:57:35.977828 31609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944: No bootstrap required, opened a new log
I20260809 18:57:35.985716 31609 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5061e9226c54e0e841f6345f7b22944" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38067 } }
I20260809 18:57:35.986020 31609 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:35.986116 31609 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5061e9226c54e0e841f6345f7b22944, State: Initialized, Role: FOLLOWER
I20260809 18:57:35.986613 31609 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5061e9226c54e0e841f6345f7b22944" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38067 } }
I20260809 18:57:35.986810 31609 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:35.986929 31609 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:35.987074 31609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:35.989136 31609 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5061e9226c54e0e841f6345f7b22944" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38067 } }
I20260809 18:57:35.989684 31609 leader_election.cc:302] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5061e9226c54e0e841f6345f7b22944; no voters:
I20260809 18:57:35.990185 31609 leader_election.cc:288] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:35.990299 31618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:35.990895 31618 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [term 1 LEADER]: Becoming Leader. State: Replica: d5061e9226c54e0e841f6345f7b22944, State: Running, Role: LEADER
I20260809 18:57:35.991384 31618 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5061e9226c54e0e841f6345f7b22944" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38067 } }
I20260809 18:57:35.991987 31609 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:35.993937 31622 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5061e9226c54e0e841f6345f7b22944. Latest consensus state: current_term: 1 leader_uuid: "d5061e9226c54e0e841f6345f7b22944" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5061e9226c54e0e841f6345f7b22944" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38067 } } }
I20260809 18:57:35.994855 31622 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:35.994499 31619 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5061e9226c54e0e841f6345f7b22944" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5061e9226c54e0e841f6345f7b22944" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38067 } } }
I20260809 18:57:35.995431 31619 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944 [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:35.996560 31637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:36.000689 31637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:36.008355 31637 catalog_manager.cc:1347] Generated new cluster ID: a1d6ebf9f3954f36b55bcb6828185a74
I20260809 18:57:36.008463 31637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:36.017815 31637 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:36.019449 31637 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:36.029558 31637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5061e9226c54e0e841f6345f7b22944: Generated new TSK 0
I20260809 18:57:36.030443 31637 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:57:36.036340 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38067
--builtin_ntp_servers=127.16.188.212:39989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 18:57:36.371066 31651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:36.371359 31651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:36.371495 31651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:36.379027 31651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:36.379137 31651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:36.379308 31651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:57:36.388171 31651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:36.389472 31651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:36.391304 31651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:36.404098 31659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:36.404161 31664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:36.404183 31661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:36.404914 31651 server_base.cc:1034] running on GCE node
I20260809 18:57:36.405514 31651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:36.406375 31651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:36.407555 31651 hybrid_clock.cc:648] HybridClock initialized: now 1786301856407510 us; error 61 us; skew 500 ppm
I20260809 18:57:36.407835 31651 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:57:36.413720 31651 webserver.cc:460] Webserver started at http://127.16.188.193:38119/ using document root <none> and password file <none>
I20260809 18:57:36.414351 31651 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:36.414439 31651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:36.414740 31651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:36.417435 31651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "8d57ef9f51d44803add4ca0669012d7d"
format_stamp: "Formatted at 2026-08-09 18:57:36 on dist-test-slave-266d"
server_key: "2f4eb7d4c4509ff6fd9300fb5c16a768"
server_key_iv: "ec211f717bb732cb600956206c0bddfe"
server_key_version: "encryptionkey@0"
I20260809 18:57:36.418156 31651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "8d57ef9f51d44803add4ca0669012d7d"
format_stamp: "Formatted at 2026-08-09 18:57:36 on dist-test-slave-266d"
server_key: "2f4eb7d4c4509ff6fd9300fb5c16a768"
server_key_iv: "ec211f717bb732cb600956206c0bddfe"
server_key_version: "encryptionkey@0"
I20260809 18:57:36.422930 31651 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 18:57:36.425992 31672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:36.427104 31651 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 18:57:36.427248 31651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "8d57ef9f51d44803add4ca0669012d7d"
format_stamp: "Formatted at 2026-08-09 18:57:36 on dist-test-slave-266d"
server_key: "2f4eb7d4c4509ff6fd9300fb5c16a768"
server_key_iv: "ec211f717bb732cb600956206c0bddfe"
server_key_version: "encryptionkey@0"
I20260809 18:57:36.427438 31651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:36.447057 31651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:36.447769 31651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:36.448029 31651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:36.448897 31651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:36.450270 31651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:36.450357 31651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:36.450455 31651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:36.450527 31651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:36.480894 31651 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:41375
I20260809 18:57:36.480958 31864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:41375 every 8 connection(s)
I20260809 18:57:36.482123 31651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:36.482636 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 31651
I20260809 18:57:36.482838 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:36.483701 17139 external_mini_cluster.cc:1428] Setting key 05649dfeee7ab5dcd7b92ad1763c8d42
I20260809 18:57:36.486888 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38067
--builtin_ntp_servers=127.16.188.212:39989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 18:57:36.495739 31871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:36.484742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:43497 (local address 127.16.188.254:38067)
0809 18:57:36.485265 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:36.485271 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:36.486601 (+ 1330us) server_negotiation.cc:407] Connection header received
0809 18:57:36.488888 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:36.488892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:36.488956 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:36.489049 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:36.490305 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:36.491009 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:36.493003 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:36.493499 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:36.493596 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:36.494963 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:36.494967 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:36.494971 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:36.494987 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:36.495025 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:36.495037 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:36.495133 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:36.495350 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 18:57:36.495454 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":230,"threads_started":1}
I20260809 18:57:36.497371 31872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:36.485368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38067 (local address 127.16.188.193:43497)
0809 18:57:36.486431 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:36.486479 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:36.488620 (+ 2141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:36.489313 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:36.489324 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:36.489429 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:36.490159 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:36.490183 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:36.491162 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:36.491166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:36.492891 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:36.492906 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:36.493694 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:36.493702 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:36.493953 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:36.494641 (+ 688us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:36.494645 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:36.494694 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:36.494794 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:36.495151 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:36.495162 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:36.495170 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 18:57:36.495335 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 18:57:36.495692 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":294,"threads_started":1}
I20260809 18:57:36.499508 31869 heartbeater.cc:347] Connected to a master server at 127.16.188.254:38067
I20260809 18:57:36.499795 31869 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:36.500504 31869 heartbeater.cc:511] Master 127.16.188.254:38067 requested a full tablet report, sending...
I20260809 18:57:36.502445 31554 ts_manager.cc:194] Registered new tserver with Master: 8d57ef9f51d44803add4ca0669012d7d (127.16.188.193:41375)
I20260809 18:57:36.503880 31554 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.193:43497
W20260809 18:57:36.808290 31873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:36.808543 31873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:36.808660 31873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:36.815577 31873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:36.815665 31873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:36.815811 31873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:57:36.824555 31873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:36.825814 31873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:36.827543 31873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:36.839720 31884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:36.839797 31885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:36.839784 31888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:36.841104 31873 server_base.cc:1034] running on GCE node
I20260809 18:57:36.841650 31873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:36.842495 31873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:36.843680 31873 hybrid_clock.cc:648] HybridClock initialized: now 1786301856843632 us; error 39 us; skew 500 ppm
I20260809 18:57:36.843967 31873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:57:36.846107 31873 webserver.cc:460] Webserver started at http://127.16.188.194:37251/ using document root <none> and password file <none>
I20260809 18:57:36.846773 31873 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:36.846863 31873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:36.847188 31873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:36.850540 31873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "00dae6f12541451eb51ffd5ddacb2471"
format_stamp: "Formatted at 2026-08-09 18:57:36 on dist-test-slave-266d"
server_key: "ea7ea4705dc907a81f8ff5cd833c3699"
server_key_iv: "590edf96ee90e2e9d4fd2a068d235593"
server_key_version: "encryptionkey@0"
I20260809 18:57:36.851280 31873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "00dae6f12541451eb51ffd5ddacb2471"
format_stamp: "Formatted at 2026-08-09 18:57:36 on dist-test-slave-266d"
server_key: "ea7ea4705dc907a81f8ff5cd833c3699"
server_key_iv: "590edf96ee90e2e9d4fd2a068d235593"
server_key_version: "encryptionkey@0"
I20260809 18:57:36.855994 31873 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 18:57:36.859225 31896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:36.860409 31873 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 18:57:36.860540 31873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "00dae6f12541451eb51ffd5ddacb2471"
format_stamp: "Formatted at 2026-08-09 18:57:36 on dist-test-slave-266d"
server_key: "ea7ea4705dc907a81f8ff5cd833c3699"
server_key_iv: "590edf96ee90e2e9d4fd2a068d235593"
server_key_version: "encryptionkey@0"
I20260809 18:57:36.860703 31873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:36.879624 31873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:36.880352 31873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:36.880596 31873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:36.881469 31873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:36.882885 31873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:36.882977 31873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:36.883054 31873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:36.883111 31873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:36.912792 31873 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:35187
I20260809 18:57:36.912869 32082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:35187 every 8 connection(s)
I20260809 18:57:36.914074 31873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:36.923293 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 31873
I20260809 18:57:36.923453 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:36.923875 17139 external_mini_cluster.cc:1428] Setting key c0548e5a77e32d8235a5dfe7a9161cb3
I20260809 18:57:36.925572 31871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:36.916472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:49833 (local address 127.16.188.254:38067)
0809 18:57:36.916644 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:36.916648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:36.917989 (+ 1341us) server_negotiation.cc:407] Connection header received
0809 18:57:36.919585 (+ 1596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:36.919589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:36.919665 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:36.919750 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:36.920670 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:36.921461 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:36.922955 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:36.923351 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:36.923471 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:36.924764 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:36.924769 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:36.924772 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:36.924789 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:36.924825 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:36.924841 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:36.924924 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:36.925157 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 18:57:36.925247 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 18:57:36.926658 32088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:36.916944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38067 (local address 127.16.188.194:49833)
0809 18:57:36.917833 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:36.917875 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:36.919369 (+ 1494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:36.919924 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:36.919932 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:36.920008 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:36.920543 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:36.920558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:36.921577 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:36.921582 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:36.922834 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:36.922846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:36.923569 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:36.923577 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:36.923793 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:36.924462 (+ 669us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:36.924464 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:36.924501 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:36.924578 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:36.924950 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:36.924958 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:36.924965 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 18:57:36.925127 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 18:57:36.925447 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":281,"threads_started":1}
I20260809 18:57:36.926940 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38067
--builtin_ntp_servers=127.16.188.212:39989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 18:57:36.927917 32084 heartbeater.cc:347] Connected to a master server at 127.16.188.254:38067
I20260809 18:57:36.928195 32084 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:36.928903 32084 heartbeater.cc:511] Master 127.16.188.254:38067 requested a full tablet report, sending...
I20260809 18:57:36.930330 31554 ts_manager.cc:194] Registered new tserver with Master: 00dae6f12541451eb51ffd5ddacb2471 (127.16.188.194:35187)
I20260809 18:57:36.931173 31554 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.194:49833
W20260809 18:57:37.251935 32093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:37.252204 32093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:37.252298 32093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:37.259279 32093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:37.259363 32093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:37.259469 32093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:57:37.268195 32093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:38067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:37.269376 32093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:37.271077 32093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:37.283123 32101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:37.283075 32103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:37.283157 32105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:37.284004 32093 server_base.cc:1034] running on GCE node
I20260809 18:57:37.284585 32093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:37.285518 32093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:37.286731 32093 hybrid_clock.cc:648] HybridClock initialized: now 1786301857286682 us; error 32 us; skew 500 ppm
I20260809 18:57:37.287037 32093 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:57:37.289206 32093 webserver.cc:460] Webserver started at http://127.16.188.195:32873/ using document root <none> and password file <none>
I20260809 18:57:37.289888 32093 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:37.289989 32093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:37.290314 32093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:37.293180 32093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "50b67e83eae04015bd429ff130dd1f13"
format_stamp: "Formatted at 2026-08-09 18:57:37 on dist-test-slave-266d"
server_key: "b44cab900d72e33975249b257e97bd86"
server_key_iv: "70585fbe0cc1a6ab9993fb7580b7a4fe"
server_key_version: "encryptionkey@0"
I20260809 18:57:37.294001 32093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "50b67e83eae04015bd429ff130dd1f13"
format_stamp: "Formatted at 2026-08-09 18:57:37 on dist-test-slave-266d"
server_key: "b44cab900d72e33975249b257e97bd86"
server_key_iv: "70585fbe0cc1a6ab9993fb7580b7a4fe"
server_key_version: "encryptionkey@0"
I20260809 18:57:37.298858 32093 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260809 18:57:37.302122 32115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:37.303332 32093 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.004s
I20260809 18:57:37.303484 32093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "50b67e83eae04015bd429ff130dd1f13"
format_stamp: "Formatted at 2026-08-09 18:57:37 on dist-test-slave-266d"
server_key: "b44cab900d72e33975249b257e97bd86"
server_key_iv: "70585fbe0cc1a6ab9993fb7580b7a4fe"
server_key_version: "encryptionkey@0"
I20260809 18:57:37.303671 32093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:37.319535 32093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:37.320317 32093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:37.320581 32093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:37.321573 32093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:37.323004 32093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:37.323098 32093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:37.323204 32093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:37.323272 32093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:37.352206 32093 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:44171
I20260809 18:57:37.352252 32286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:44171 every 8 connection(s)
I20260809 18:57:37.353494 32093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:37.361573 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 32093
I20260809 18:57:37.361735 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:37.362160 17139 external_mini_cluster.cc:1428] Setting key 9e6681ba2758c9135f0eb10f54bd97ac
I20260809 18:57:37.365199 31871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:37.355871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:35475 (local address 127.16.188.254:38067)
0809 18:57:37.356073 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:37.356078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:37.357410 (+ 1332us) server_negotiation.cc:407] Connection header received
0809 18:57:37.359097 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:37.359101 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:37.359168 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:37.359244 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:37.360197 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.360893 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.362481 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.362941 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.363051 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:37.364396 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:37.364401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:37.364404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:37.364419 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:37.364451 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:37.364467 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:37.364553 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:37.364761 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 18:57:37.364872 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 18:57:37.366151 32291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:37.356358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38067 (local address 127.16.188.195:35475)
0809 18:57:37.357247 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:37.357302 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:37.358846 (+ 1544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:37.359438 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:37.359445 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:37.359524 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:37.360069 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:37.360084 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.361005 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.361009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:37.362345 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:37.362358 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.363160 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.363166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:37.363429 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:37.364083 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:37.364087 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:37.364140 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:37.364237 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:37.364565 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:37.364575 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:37.364583 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 18:57:37.364761 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 18:57:37.365170 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":258,"threads_started":1}
I20260809 18:57:37.367316 32287 heartbeater.cc:347] Connected to a master server at 127.16.188.254:38067
I20260809 18:57:37.367573 32287 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:37.368283 32287 heartbeater.cc:511] Master 127.16.188.254:38067 requested a full tablet report, sending...
I20260809 18:57:37.369560 31554 ts_manager.cc:194] Registered new tserver with Master: 50b67e83eae04015bd429ff130dd1f13 (127.16.188.195:44171)
I20260809 18:57:37.370357 31554 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.195:35475
I20260809 18:57:37.377354 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:57:37.383124 31871 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:37.381481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47934 (local address 127.16.188.254:38067)
0809 18:57:37.381635 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:37.381639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:37.382144 (+ 505us) server_negotiation.cc:407] Connection header received
0809 18:57:37.382304 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:37.382309 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:37.382387 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:37.382466 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:37.382892 (+ 426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47934: BlockingRecv error: recv got EOF from 127.0.0.1:47934 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:57:37.383797 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 31651
I20260809 18:57:37.390789 32301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:37.384599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55554 (local address 127.16.188.193:41375)
0809 18:57:37.385056 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:37.385071 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:37.385120 (+ 49us) server_negotiation.cc:407] Connection header received
0809 18:57:37.385190 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:37.385197 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:37.385385 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:37.385505 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:37.385851 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.386810 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.387994 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.388511 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.388599 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:37.389569 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:37.389576 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:37.389588 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:37.390143 (+ 555us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:37.390193 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:37.390212 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:37.390296 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:37.390381 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 18:57:37.390502 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":240,"threads_started":1}
I20260809 18:57:37.392017 31855 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:37.471839 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 31651
I20260809 18:57:37.497044 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 31873
I20260809 18:57:37.504803 32303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:37.497970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.16.188.194:35187)
0809 18:57:37.498470 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:37.498477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:37.498506 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:57:37.498568 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:37.498575 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:37.498795 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:37.498917 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:37.499295 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.500286 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.501861 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.502416 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.502516 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:37.503445 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:37.503454 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:37.503468 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:37.504074 (+ 606us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:37.504123 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:37.504144 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:37.504231 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:37.504364 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 18:57:37.504476 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":234,"threads_started":1}
I20260809 18:57:37.506033 32077 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:37.648123 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 31873
I20260809 18:57:37.716257 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 32093
I20260809 18:57:37.742439 32306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:37.719813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53432 (local address 127.16.188.195:44171)
0809 18:57:37.722184 (+ 2371us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:37.722230 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:37.722402 (+ 172us) server_negotiation.cc:407] Connection header received
0809 18:57:37.722658 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:37.722728 (+ 70us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:37.723628 (+ 900us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:37.724410 (+ 782us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:37.726807 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.730454 (+ 3647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.734323 (+ 3869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:37.735623 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:37.735932 (+ 309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:37.738131 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:37.738148 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:37.738177 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:37.739582 (+ 1405us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:37.739807 (+ 225us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:37.739879 (+ 72us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:37.740071 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:37.740717 (+ 646us) server_negotiation.cc:299] Negotiation successful
0809 18:57:37.741392 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1849,"thread_start_us":1425,"threads_started":1}
I20260809 18:57:37.745131 32281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:38.019429 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 32093
I20260809 18:57:38.084074 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 31509
I20260809 18:57:38.089308 31604 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:38.450111 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 31509
2026-08-09T18:57:38Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (3080 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T18:57:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:38Z Disabled control of system clock
I20260809 18:57:38.685798 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:41743
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:41743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:57:39.073800 32314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:39.074066 32314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:39.074157 32314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:39.081061 32314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:39.081172 32314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:39.081216 32314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:39.081270 32314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:39.081312 32314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:39.090034 32314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:41743
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:41743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:39.091202 32314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:39.092916 32314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:39.104341 32327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:39.104437 32322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:39.104383 32323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:39.105060 32314 server_base.cc:1034] running on GCE node
I20260809 18:57:39.105805 32314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:39.107182 32314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:39.108377 32314 hybrid_clock.cc:648] HybridClock initialized: now 1786301859108340 us; error 30 us; skew 500 ppm
I20260809 18:57:39.108700 32314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:57:39.110816 32314 webserver.cc:460] Webserver started at http://127.16.188.254:34761/ using document root <none> and password file <none>
I20260809 18:57:39.111461 32314 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:39.111553 32314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:39.111847 32314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:39.114671 32314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "666be443c34e4e22be27508fbde1881e"
format_stamp: "Formatted at 2026-08-09 18:57:39 on dist-test-slave-266d"
server_key: "ebd0f622bce7e98ffc9e409e6ed18f9b"
server_key_iv: "16d4899f3c3a9555f61242532dbe3b81"
server_key_version: "encryptionkey@0"
I20260809 18:57:39.115449 32314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "666be443c34e4e22be27508fbde1881e"
format_stamp: "Formatted at 2026-08-09 18:57:39 on dist-test-slave-266d"
server_key: "ebd0f622bce7e98ffc9e409e6ed18f9b"
server_key_iv: "16d4899f3c3a9555f61242532dbe3b81"
server_key_version: "encryptionkey@0"
I20260809 18:57:39.120167 32314 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 18:57:39.123340 32338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:39.124606 32314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:57:39.124756 32314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "666be443c34e4e22be27508fbde1881e"
format_stamp: "Formatted at 2026-08-09 18:57:39 on dist-test-slave-266d"
server_key: "ebd0f622bce7e98ffc9e409e6ed18f9b"
server_key_iv: "16d4899f3c3a9555f61242532dbe3b81"
server_key_version: "encryptionkey@0"
I20260809 18:57:39.124938 32314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:39.130149 32314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:39.130831 32314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:39.131085 32314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:39.146302 32314 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:41743
I20260809 18:57:39.146340 32423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:41743 every 8 connection(s)
I20260809 18:57:39.147469 32314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:39.150859 32424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:39.154440 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 32314
I20260809 18:57:39.154614 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:57:39.155257 17139 external_mini_cluster.cc:1428] Setting key c1fadc0896cdc3a5d6b46ab444fba5b1
I20260809 18:57:39.162547 32424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e: Bootstrap starting.
I20260809 18:57:39.164462 32429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:39.157076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33528 (local address 127.16.188.254:41743)
0809 18:57:39.158108 (+ 1032us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:39.158122 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:39.158171 (+ 49us) server_negotiation.cc:407] Connection header received
0809 18:57:39.160662 (+ 2491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:39.160690 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:39.161203 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:39.161597 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:39.162559 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:39.162568 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:39.162583 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:39.162601 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:39.162678 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:39.162701 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:39.162934 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:39.163058 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 18:57:39.163314 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":323,"threads_started":1}
I20260809 18:57:39.166280 32424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:39.167487 32424 log.cc:824] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:39.169931 32424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e: No bootstrap required, opened a new log
I20260809 18:57:39.176700 32424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666be443c34e4e22be27508fbde1881e" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41743 } }
I20260809 18:57:39.177002 32424 raft_consensus.cc:374] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:39.177078 32424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666be443c34e4e22be27508fbde1881e, State: Initialized, Role: FOLLOWER
I20260809 18:57:39.177628 32424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666be443c34e4e22be27508fbde1881e" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41743 } }
I20260809 18:57:39.177824 32424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:39.177937 32424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:39.178088 32424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:39.180255 32424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666be443c34e4e22be27508fbde1881e" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41743 } }
I20260809 18:57:39.180675 32424 leader_election.cc:302] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 666be443c34e4e22be27508fbde1881e; no voters:
I20260809 18:57:39.181241 32424 leader_election.cc:288] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:39.181334 32431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:39.182009 32431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [term 1 LEADER]: Becoming Leader. State: Replica: 666be443c34e4e22be27508fbde1881e, State: Running, Role: LEADER
I20260809 18:57:39.182523 32431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666be443c34e4e22be27508fbde1881e" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41743 } }
I20260809 18:57:39.183156 32424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:39.184962 32436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 666be443c34e4e22be27508fbde1881e. Latest consensus state: current_term: 1 leader_uuid: "666be443c34e4e22be27508fbde1881e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666be443c34e4e22be27508fbde1881e" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41743 } } }
I20260809 18:57:39.185380 32436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:39.185477 32433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "666be443c34e4e22be27508fbde1881e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666be443c34e4e22be27508fbde1881e" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41743 } } }
I20260809 18:57:39.185922 32433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:39.187141 32444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:39.191992 32444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:39.200354 32444 catalog_manager.cc:1347] Generated new cluster ID: 972942a82af0490a91f3430a793151d3
I20260809 18:57:39.200461 32444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:39.216542 32444 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:39.216995 32444 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:39.224808 32444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 666be443c34e4e22be27508fbde1881e: Generated new TSK 0
I20260809 18:57:39.225734 32444 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:57:39.234797 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:41743
--builtin_ntp_servers=127.16.188.212:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:57:39.569360 32468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:39.569646 32468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:39.569782 32468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:39.576874 32468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:39.576982 32468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:39.577155 32468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:57:39.586218 32468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:41743
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:39.587541 32468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:39.589382 32468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:39.601811 32481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:39.601848 32480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:39.601764 32484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:39.602596 32468 server_base.cc:1034] running on GCE node
I20260809 18:57:39.603170 32468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:39.604077 32468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:39.605264 32468 hybrid_clock.cc:648] HybridClock initialized: now 1786301859605215 us; error 35 us; skew 500 ppm
I20260809 18:57:39.605556 32468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:57:39.607780 32468 webserver.cc:460] Webserver started at http://127.16.188.193:44277/ using document root <none> and password file <none>
I20260809 18:57:39.608502 32468 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:39.608613 32468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:39.608927 32468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:39.611732 32468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "f395d58c4c704f489bdc36fbe2e4c53e"
format_stamp: "Formatted at 2026-08-09 18:57:39 on dist-test-slave-266d"
server_key: "f0246f6205be520e9b14283a160fcd12"
server_key_iv: "ee29bf0c3c9f9162a2cb7637412f3363"
server_key_version: "encryptionkey@0"
I20260809 18:57:39.612478 32468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "f395d58c4c704f489bdc36fbe2e4c53e"
format_stamp: "Formatted at 2026-08-09 18:57:39 on dist-test-slave-266d"
server_key: "f0246f6205be520e9b14283a160fcd12"
server_key_iv: "ee29bf0c3c9f9162a2cb7637412f3363"
server_key_version: "encryptionkey@0"
I20260809 18:57:39.617362 32468 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 18:57:39.620536 32494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:39.621783 32468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:57:39.621920 32468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "f395d58c4c704f489bdc36fbe2e4c53e"
format_stamp: "Formatted at 2026-08-09 18:57:39 on dist-test-slave-266d"
server_key: "f0246f6205be520e9b14283a160fcd12"
server_key_iv: "ee29bf0c3c9f9162a2cb7637412f3363"
server_key_version: "encryptionkey@0"
I20260809 18:57:39.622098 32468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:39.627250 32468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:39.628065 32468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:39.628294 32468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:39.629208 32468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:39.630532 32468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:39.630630 32468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:39.630730 32468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:39.630808 32468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:39.660254 32468 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:46601
I20260809 18:57:39.660310 32666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:46601 every 8 connection(s)
I20260809 18:57:39.661509 32468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:39.668798 32429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:39.663939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:38577 (local address 127.16.188.254:41743)
0809 18:57:39.664114 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:39.664119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:39.665449 (+ 1330us) server_negotiation.cc:407] Connection header received
0809 18:57:39.667002 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:39.667006 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:39.667058 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:39.667148 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:39.668233 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:39.668237 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:39.668240 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:39.668255 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:39.668287 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:39.668298 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:39.668385 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:39.668528 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 18:57:39.668577 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 18:57:39.669720 32669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:39.664412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:41743 (local address 127.16.188.193:38577)
0809 18:57:39.665312 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:39.665348 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:39.666794 (+ 1446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:39.667328 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:39.667335 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:39.667416 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:39.667975 (+ 559us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:39.667977 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:39.668011 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:39.668084 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:39.668367 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:39.668373 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:39.668377 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:57:39.668581 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 18:57:39.668811 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":255,"threads_started":1}
I20260809 18:57:39.671046 32667 heartbeater.cc:347] Connected to a master server at 127.16.188.254:41743
I20260809 18:57:39.671278 32667 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:39.671831 32667 heartbeater.cc:511] Master 127.16.188.254:41743 requested a full tablet report, sending...
I20260809 18:57:39.671911 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 32468
I20260809 18:57:39.672086 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:39.672686 17139 external_mini_cluster.cc:1428] Setting key da0e45482f947824b13e02103c25e738
I20260809 18:57:39.673952 32365 ts_manager.cc:194] Registered new tserver with Master: f395d58c4c704f489bdc36fbe2e4c53e (127.16.188.193:46601)
I20260809 18:57:39.675606 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:41743
--builtin_ntp_servers=127.16.188.212:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:57:40.012092 32670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:40.012384 32670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:40.012490 32670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:40.019699 32670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:40.019809 32670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:40.019929 32670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:57:40.029124 32670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:41743
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:40.030401 32670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:40.032184 32670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:40.044845 32680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:40.044874 32681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:40.044904 32683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:40.045902 32670 server_base.cc:1034] running on GCE node
I20260809 18:57:40.046465 32670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:40.047367 32670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:40.048583 32670 hybrid_clock.cc:648] HybridClock initialized: now 1786301860048524 us; error 39 us; skew 500 ppm
I20260809 18:57:40.048890 32670 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:57:40.051162 32670 webserver.cc:460] Webserver started at http://127.16.188.194:40127/ using document root <none> and password file <none>
I20260809 18:57:40.051824 32670 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:40.051934 32670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:40.052268 32670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:40.055578 32670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "d2968973ac304866936d62e290b041bc"
format_stamp: "Formatted at 2026-08-09 18:57:40 on dist-test-slave-266d"
server_key: "590680342fd4cd27a2fa48f7f9433c53"
server_key_iv: "277cd72971c2d4c0b3c2ea50d431dc2d"
server_key_version: "encryptionkey@0"
I20260809 18:57:40.056445 32670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "d2968973ac304866936d62e290b041bc"
format_stamp: "Formatted at 2026-08-09 18:57:40 on dist-test-slave-266d"
server_key: "590680342fd4cd27a2fa48f7f9433c53"
server_key_iv: "277cd72971c2d4c0b3c2ea50d431dc2d"
server_key_version: "encryptionkey@0"
I20260809 18:57:40.061548 32670 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 18:57:40.064940 32692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:40.066272 32670 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 18:57:40.066435 32670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "d2968973ac304866936d62e290b041bc"
format_stamp: "Formatted at 2026-08-09 18:57:40 on dist-test-slave-266d"
server_key: "590680342fd4cd27a2fa48f7f9433c53"
server_key_iv: "277cd72971c2d4c0b3c2ea50d431dc2d"
server_key_version: "encryptionkey@0"
I20260809 18:57:40.066649 32670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:40.072337 32670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:40.073212 32670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:40.073484 32670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:40.074395 32670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:40.075816 32670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:40.075923 32670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:40.076041 32670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:40.076129 32670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:40.107445 32670 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:33255
I20260809 18:57:40.107494 401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:33255 every 8 connection(s)
I20260809 18:57:40.108781 32670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:40.110966 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 32670
I20260809 18:57:40.111162 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:40.111737 17139 external_mini_cluster.cc:1428] Setting key 732caa1e05fee70d88d062ddd3691679
I20260809 18:57:40.114714 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:41743
--builtin_ntp_servers=127.16.188.212:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 18:57:40.117147 32429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:40.111288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:33109 (local address 127.16.188.254:41743)
0809 18:57:40.111458 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:40.111462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:40.113192 (+ 1730us) server_negotiation.cc:407] Connection header received
0809 18:57:40.115038 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:40.115043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:40.115107 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:40.115191 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:40.116434 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:40.116439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:40.116442 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:40.116457 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:40.116488 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:40.116499 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:40.116593 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:40.116776 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 18:57:40.116841 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 18:57:40.117993 405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:40.111987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:41743 (local address 127.16.188.194:33109)
0809 18:57:40.113032 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:40.113077 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:40.114758 (+ 1681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:40.115420 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:40.115427 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:40.115512 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:40.116149 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:40.116151 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:40.116185 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:40.116273 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:40.116580 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:40.116589 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:40.116596 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 18:57:40.116835 (+ 239us) client_negotiation.cc:240] Negotiation successful
0809 18:57:40.117064 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":324,"threads_started":1}
I20260809 18:57:40.119300 402 heartbeater.cc:347] Connected to a master server at 127.16.188.254:41743
I20260809 18:57:40.119553 402 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:40.120160 402 heartbeater.cc:511] Master 127.16.188.254:41743 requested a full tablet report, sending...
I20260809 18:57:40.121511 32365 ts_manager.cc:194] Registered new tserver with Master: d2968973ac304866936d62e290b041bc (127.16.188.194:33255)
W20260809 18:57:40.443418 408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:40.443766 408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:40.443912 408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:40.451115 408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:40.451220 408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:40.451363 408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:57:40.460430 408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:41743
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:40.461776 408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:40.463538 408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:40.475979 414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:40.476045 418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:40.476002 415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:40.476753 408 server_base.cc:1034] running on GCE node
I20260809 18:57:40.477311 408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:40.478242 408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:40.479439 408 hybrid_clock.cc:648] HybridClock initialized: now 1786301860479401 us; error 32 us; skew 500 ppm
I20260809 18:57:40.479735 408 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 18:57:40.481940 408 webserver.cc:460] Webserver started at http://127.16.188.195:37335/ using document root <none> and password file <none>
I20260809 18:57:40.482589 408 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:40.482685 408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:40.482998 408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:40.485909 408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "352bec12cc8248638ef5b1216f61b9f2"
format_stamp: "Formatted at 2026-08-09 18:57:40 on dist-test-slave-266d"
server_key: "1c9925bf929a9e72013c502dbba0774c"
server_key_iv: "0454618dc97ac11c3b6be2703a62bacc"
server_key_version: "encryptionkey@0"
I20260809 18:57:40.486673 408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "352bec12cc8248638ef5b1216f61b9f2"
format_stamp: "Formatted at 2026-08-09 18:57:40 on dist-test-slave-266d"
server_key: "1c9925bf929a9e72013c502dbba0774c"
server_key_iv: "0454618dc97ac11c3b6be2703a62bacc"
server_key_version: "encryptionkey@0"
I20260809 18:57:40.491540 408 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 18:57:40.494769 429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:40.495977 408 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:57:40.496124 408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "352bec12cc8248638ef5b1216f61b9f2"
format_stamp: "Formatted at 2026-08-09 18:57:40 on dist-test-slave-266d"
server_key: "1c9925bf929a9e72013c502dbba0774c"
server_key_iv: "0454618dc97ac11c3b6be2703a62bacc"
server_key_version: "encryptionkey@0"
I20260809 18:57:40.496333 408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:40.501745 408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:40.502461 408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:40.502702 408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:40.503546 408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:40.504874 408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:40.504963 408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:40.505076 408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:40.505225 408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 18:57:40.535094 408 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:33315
I20260809 18:57:40.535153 609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:33315 every 8 connection(s)
I20260809 18:57:40.536371 408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:40.540369 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 408
I20260809 18:57:40.540540 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:40.541146 17139 external_mini_cluster.cc:1428] Setting key 36b30f95b8b0b4582b167a07918a5d66
I20260809 18:57:40.544879 32429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:40.538894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:41809 (local address 127.16.188.254:41743)
0809 18:57:40.539113 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:40.539120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:40.540703 (+ 1583us) server_negotiation.cc:407] Connection header received
0809 18:57:40.542756 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:40.542760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:40.542814 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:40.542892 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:40.544256 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:40.544262 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:40.544267 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:40.544286 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:40.544318 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:40.544330 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:40.544427 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:40.544626 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 18:57:40.544685 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:57:40.545778 620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:40.539419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:41743 (local address 127.16.188.195:41809)
0809 18:57:40.540483 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:40.540538 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:40.542472 (+ 1934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:40.543130 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:40.543141 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:40.543263 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:40.543924 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:57:40.543927 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:40.543972 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:57:40.544091 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:40.544425 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:40.544437 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:40.544445 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 18:57:40.544690 (+ 245us) client_negotiation.cc:240] Negotiation successful
0809 18:57:40.544875 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":268,"threads_started":1}
I20260809 18:57:40.546913 616 heartbeater.cc:347] Connected to a master server at 127.16.188.254:41743
I20260809 18:57:40.547194 616 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:40.547761 616 heartbeater.cc:511] Master 127.16.188.254:41743 requested a full tablet report, sending...
I20260809 18:57:40.548998 32365 ts_manager.cc:194] Registered new tserver with Master: 352bec12cc8248638ef5b1216f61b9f2 (127.16.188.195:33315)
I20260809 18:57:40.556234 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:57:40.562058 32429 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:57:40.560472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38804 (local address 127.16.188.254:41743)
0809 18:57:40.560638 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:40.560644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:40.561273 (+ 629us) server_negotiation.cc:407] Connection header received
0809 18:57:40.561401 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:40.561404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:40.561452 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:40.561526 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:40.561821 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38804: BlockingRecv error: recv got EOF from 127.0.0.1:38804 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:57:40.562495 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 32468
I20260809 18:57:40.566533 630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:40.563999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58418 (local address 127.16.188.193:46601)
0809 18:57:40.564506 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:40.564512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:40.564535 (+ 23us) server_negotiation.cc:407] Connection header received
0809 18:57:40.564587 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:40.564593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:40.564772 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:40.564901 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:40.565858 (+ 957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:40.565864 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:40.565874 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:40.565887 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:40.565931 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:40.565944 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:40.566060 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:40.566180 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 18:57:40.566283 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":263,"threads_started":1}
I20260809 18:57:40.567591 32661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:40.646647 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 32468
I20260809 18:57:40.670478 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 32670
I20260809 18:57:40.673911 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:40.671444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36976 (local address 127.16.188.194:33255)
0809 18:57:40.671956 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:40.671962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:40.671990 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:57:40.672055 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:40.672061 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:40.672268 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:40.672397 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:40.673263 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:40.673270 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:40.673282 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:40.673297 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:40.673346 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:40.673365 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:40.673465 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:40.673532 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 18:57:40.673627 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":223,"threads_started":1}
I20260809 18:57:40.675077 388 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:40.754544 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 32670
I20260809 18:57:40.774571 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 408
I20260809 18:57:40.781229 635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:40.775608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53832 (local address 127.16.188.195:33315)
0809 18:57:40.776272 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:40.776279 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:40.776323 (+ 44us) server_negotiation.cc:407] Connection header received
0809 18:57:40.776387 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:40.776395 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:40.776623 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:40.776746 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:40.780457 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:40.780465 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:40.780478 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:57:40.780501 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:40.780550 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:57:40.780568 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:40.780725 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:40.780781 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 18:57:40.780881 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":348,"threads_started":1}
I20260809 18:57:40.782439 600 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:40.861635 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 408
I20260809 18:57:40.885332 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 32314
I20260809 18:57:40.886499 32415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:40.984807 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 32314
2026-08-09T18:57:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2446 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:41 dist-test-slave-266d krb5kdc[640](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:41 dist-test-slave-266d krb5kdc[640](info): set up 2 sockets
Aug 09 18:57:41 dist-test-slave-266d krb5kdc[640](info): commencing operation
krb5kdc: starting...
W20260809 18:57:42.219554 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:57:42 dist-test-slave-266d krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:57:42.460075 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:39819
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:45335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:39819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:42.780354 659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:42.780632 659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:42.780769 659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:42.787693 659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:57:42.787793 659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:42.787851 659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:42.787906 659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:57:42.787949 659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:57:42.797219 659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:45335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:39819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:39819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:42.798331 659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:42.799489 659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:42.810230 671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:42.810369 667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:42.810525 666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:42.811121 659 server_base.cc:1034] running on GCE node
I20260809 18:57:42.811841 659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:42.813352 659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:42.814603 659 hybrid_clock.cc:648] HybridClock initialized: now 1786301862814524 us; error 40 us; skew 500 ppm
I20260809 18:57:42.814936 659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:42 dist-test-slave-266d krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301862, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:42.820408 659 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:57:42.821846 659 webserver.cc:460] Webserver started at http://127.16.188.254:34149/ using document root <none> and password file <none>
I20260809 18:57:42.822472 659 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:42.822594 659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:42.822885 659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:42.825800 659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "5b540e23d338406fb32f0037c569fd4c"
format_stamp: "Formatted at 2026-08-09 18:57:42 on dist-test-slave-266d"
server_key: "680d7f5815e36d263baaea2e5a147022"
server_key_iv: "818798f1f855389884a585cafb296480"
server_key_version: "encryptionkey@0"
I20260809 18:57:42.826531 659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "5b540e23d338406fb32f0037c569fd4c"
format_stamp: "Formatted at 2026-08-09 18:57:42 on dist-test-slave-266d"
server_key: "680d7f5815e36d263baaea2e5a147022"
server_key_iv: "818798f1f855389884a585cafb296480"
server_key_version: "encryptionkey@0"
I20260809 18:57:42.831508 659 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 18:57:42.834796 685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:42.835983 659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:57:42.836146 659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "5b540e23d338406fb32f0037c569fd4c"
format_stamp: "Formatted at 2026-08-09 18:57:42 on dist-test-slave-266d"
server_key: "680d7f5815e36d263baaea2e5a147022"
server_key_iv: "818798f1f855389884a585cafb296480"
server_key_version: "encryptionkey@0"
I20260809 18:57:42.836323 659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:42.850778 659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:42.854719 659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:42.854974 659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:42.871896 659 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:39819
I20260809 18:57:42.871958 761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:39819 every 8 connection(s)
I20260809 18:57:42.873240 659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:57:42.877122 762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:42.882351 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 659
I20260809 18:57:42.882540 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:57:42.883163 17139 external_mini_cluster.cc:1428] Setting key 422755723fc9470c1180c004703e5a08
I20260809 18:57:42.888190 762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c: Bootstrap starting.
I20260809 18:57:42.891726 762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:42.892959 762 log.cc:824] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:42.896381 762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c: No bootstrap required, opened a new log
Aug 09 18:57:42 dist-test-slave-266d krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:57:42.906329 762 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b540e23d338406fb32f0037c569fd4c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39819 } }
I20260809 18:57:42.906773 762 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:42.906829 768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:42.884991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38614 (local address 127.16.188.254:39819)
0809 18:57:42.885774 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:42.885786 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:42.885833 (+ 47us) server_negotiation.cc:407] Connection header received
0809 18:57:42.887460 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:42.887485 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:42.887848 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:42.888155 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:42.890139 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:42.891391 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:42.893122 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:42.894047 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:42.894236 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:42.898734 (+ 4498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:42.898746 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:42.898765 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:42.898814 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:42.902608 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:42.903246 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:42.903254 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:42.903263 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:42.903477 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:42.903773 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:42.903782 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:42.903785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:42.904484 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:42.904812 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:42.905130 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 18:57:42.905555 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":325,"threads_started":1}
I20260809 18:57:42.906896 762 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b540e23d338406fb32f0037c569fd4c, State: Initialized, Role: FOLLOWER
I20260809 18:57:42.907452 762 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b540e23d338406fb32f0037c569fd4c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39819 } }
I20260809 18:57:42.907684 762 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:57:42.907814 762 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:57:42.907974 762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:42.910267 762 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b540e23d338406fb32f0037c569fd4c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39819 } }
I20260809 18:57:42.910713 762 leader_election.cc:302] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b540e23d338406fb32f0037c569fd4c; no voters:
I20260809 18:57:42.911314 762 leader_election.cc:288] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:57:42.911410 770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:42.912061 770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [term 1 LEADER]: Becoming Leader. State: Replica: 5b540e23d338406fb32f0037c569fd4c, State: Running, Role: LEADER
I20260809 18:57:42.912664 770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b540e23d338406fb32f0037c569fd4c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39819 } }
I20260809 18:57:42.913492 762 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:57:42.915678 771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b540e23d338406fb32f0037c569fd4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b540e23d338406fb32f0037c569fd4c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39819 } } }
I20260809 18:57:42.915714 774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b540e23d338406fb32f0037c569fd4c. Latest consensus state: current_term: 1 leader_uuid: "5b540e23d338406fb32f0037c569fd4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b540e23d338406fb32f0037c569fd4c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39819 } } }
I20260809 18:57:42.916029 771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:42.916072 774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c [sys.catalog]: This master's current role is: LEADER
I20260809 18:57:42.917577 783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:57:42.922601 783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:57:42.930868 783 catalog_manager.cc:1347] Generated new cluster ID: 6986e21cd4914ab286189405aa6353f3
I20260809 18:57:42.930970 783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:57:42.959553 783 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:57:42.960786 783 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:57:42.967623 783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c: Generated new TSK 0
I20260809 18:57:42.968467 783 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:57:43.050204 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39819
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:45335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:43.389279 803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:43.389534 803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:43.389676 803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:43.396755 803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:43.396852 803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:43.396989 803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:57:43.406678 803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:45335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:43.407956 803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:43.409289 803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:43.422041 811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:43.422113 810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:43.422080 815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:43.422747 803 server_base.cc:1034] running on GCE node
I20260809 18:57:43.423336 803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:43.424399 803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:43.425607 803 hybrid_clock.cc:648] HybridClock initialized: now 1786301863425545 us; error 51 us; skew 500 ppm
I20260809 18:57:43.426018 803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:43 dist-test-slave-266d krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301863, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:43.429073 803 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:57:43.430434 803 webserver.cc:460] Webserver started at http://127.16.188.193:32963/ using document root <none> and password file <none>
I20260809 18:57:43.431062 803 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:43.431161 803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:43.431404 803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:43.434208 803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "7a6d4f80b8af44009f3dae4397ca78cd"
format_stamp: "Formatted at 2026-08-09 18:57:43 on dist-test-slave-266d"
server_key: "df62954d367becff8329fa8f94b8acf6"
server_key_iv: "980e40c1e031ea558471580bb8101b2f"
server_key_version: "encryptionkey@0"
I20260809 18:57:43.434928 803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "7a6d4f80b8af44009f3dae4397ca78cd"
format_stamp: "Formatted at 2026-08-09 18:57:43 on dist-test-slave-266d"
server_key: "df62954d367becff8329fa8f94b8acf6"
server_key_iv: "980e40c1e031ea558471580bb8101b2f"
server_key_version: "encryptionkey@0"
I20260809 18:57:43.439775 803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260809 18:57:43.443073 825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:43.444341 803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:57:43.444499 803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "7a6d4f80b8af44009f3dae4397ca78cd"
format_stamp: "Formatted at 2026-08-09 18:57:43 on dist-test-slave-266d"
server_key: "df62954d367becff8329fa8f94b8acf6"
server_key_iv: "980e40c1e031ea558471580bb8101b2f"
server_key_version: "encryptionkey@0"
I20260809 18:57:43.444671 803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:43.464461 803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:43.468559 803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:43.468843 803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:43.469763 803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:43.471057 803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:43.471129 803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:43.471253 803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:43.471304 803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:43.501267 803 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:41885
I20260809 18:57:43.501317 1022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:41885 every 8 connection(s)
I20260809 18:57:43.502506 803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:57:43.509656 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 803
I20260809 18:57:43.509970 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:57:43.510648 17139 external_mini_cluster.cc:1428] Setting key f548bf671c51c6d5a903d0a5be9286dc
Aug 09 18:57:43 dist-test-slave-266d krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301863, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:57:43.523193 1026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:43.504975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:53831 (local address 127.16.188.254:39819)
0809 18:57:43.505434 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:43.505438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:43.506387 (+ 949us) server_negotiation.cc:407] Connection header received
0809 18:57:43.508149 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:43.508155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:43.508234 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:43.508335 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:43.510048 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:43.510808 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:43.512678 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:43.513111 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:43.513222 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:43.517258 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:43.517264 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:43.517269 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:43.517308 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:43.520257 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:43.520929 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:43.520935 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:43.520938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:43.521125 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:43.521518 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:43.521523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:43.521526 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:43.521851 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:43.521988 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:43.522627 (+ 639us) server_negotiation.cc:299] Negotiation successful
0809 18:57:43.522852 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":237,"threads_started":1}
I20260809 18:57:43.523927 1027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:43.505547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39819 (local address 127.16.188.193:53831)
0809 18:57:43.506232 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:43.506269 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:43.507878 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:43.508574 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:43.508582 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:43.509058 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:43.509855 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:43.509882 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:43.510985 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:43.510991 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:43.512533 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:43.512546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:43.513348 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:43.513356 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:43.513634 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:43.514336 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:43.514370 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:43.516986 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:43.520384 (+ 3398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:43.520391 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:43.520402 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:43.520802 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:43.521216 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:43.521219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:43.521222 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:43.521408 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:43.521949 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:43.521954 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:43.522248 (+ 294us) client_negotiation.cc:769] Sending connection context
0809 18:57:43.522475 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 18:57:43.522844 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":248,"threads_started":1}
I20260809 18:57:43.525559 1024 heartbeater.cc:347] Connected to a master server at 127.16.188.254:39819
I20260809 18:57:43.525846 1024 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:43.526619 1024 heartbeater.cc:511] Master 127.16.188.254:39819 requested a full tablet report, sending...
I20260809 18:57:43.528841 715 ts_manager.cc:194] Registered new tserver with Master: 7a6d4f80b8af44009f3dae4397ca78cd (127.16.188.193:41885)
I20260809 18:57:43.530316 715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:53831
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:57:43.570312 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39819
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:45335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:43.890329 1031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:43.890628 1031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:43.890766 1031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:43.898150 1031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:43.898288 1031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:43.898465 1031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:57:43.908016 1031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:45335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:43.909283 1031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:43.910529 1031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:43.923377 1048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:43.923329 1050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:43.923550 1046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:43.923861 1031 server_base.cc:1034] running on GCE node
I20260809 18:57:43.924782 1031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:43.925717 1031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:43.926923 1031 hybrid_clock.cc:648] HybridClock initialized: now 1786301863926881 us; error 28 us; skew 500 ppm
I20260809 18:57:43.927219 1031 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:43 dist-test-slave-266d krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301863, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:43.930212 1031 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:57:43.931591 1031 webserver.cc:460] Webserver started at http://127.16.188.194:43803/ using document root <none> and password file <none>
I20260809 18:57:43.932231 1031 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:43.932345 1031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:43.932650 1031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:43.935549 1031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "3e0199d377194e83a0979fc554bf4723"
format_stamp: "Formatted at 2026-08-09 18:57:43 on dist-test-slave-266d"
server_key: "42e7234187b838f45ef2b2f362f56809"
server_key_iv: "6d2e942e0a54f8fd23fa25b893a4cb3d"
server_key_version: "encryptionkey@0"
I20260809 18:57:43.936331 1031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "3e0199d377194e83a0979fc554bf4723"
format_stamp: "Formatted at 2026-08-09 18:57:43 on dist-test-slave-266d"
server_key: "42e7234187b838f45ef2b2f362f56809"
server_key_iv: "6d2e942e0a54f8fd23fa25b893a4cb3d"
server_key_version: "encryptionkey@0"
I20260809 18:57:43.941424 1031 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 18:57:43.944723 1059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:43.946062 1031 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:57:43.946230 1031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "3e0199d377194e83a0979fc554bf4723"
format_stamp: "Formatted at 2026-08-09 18:57:43 on dist-test-slave-266d"
server_key: "42e7234187b838f45ef2b2f362f56809"
server_key_iv: "6d2e942e0a54f8fd23fa25b893a4cb3d"
server_key_version: "encryptionkey@0"
I20260809 18:57:43.946409 1031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:43.984692 1031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:43.990284 1031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:43.990643 1031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:43.991804 1031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:43.993271 1031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:43.993346 1031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:43.993448 1031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:43.993490 1031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:44.022832 1031 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:37779
I20260809 18:57:44.022876 1237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:37779 every 8 connection(s)
I20260809 18:57:44.024165 1031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:57:44.032457 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 1031
I20260809 18:57:44.032631 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:57:44.033123 17139 external_mini_cluster.cc:1428] Setting key 68cd096bad9212de74d898d948df4223
Aug 09 18:57:44 dist-test-slave-266d krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301863, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:57:44.043638 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.026657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:33031 (local address 127.16.188.254:39819)
0809 18:57:44.027084 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.027089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.028075 (+ 986us) server_negotiation.cc:407] Connection header received
0809 18:57:44.029856 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.029860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.029930 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.030017 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:44.031359 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.032038 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.033627 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.034066 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.034203 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.038028 (+ 3825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:44.038033 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:44.038036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:44.038068 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:44.040625 (+ 2557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.041450 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.041454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.041457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.041584 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.041994 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.041997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.041998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.042250 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:44.042354 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.043167 (+ 813us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.043351 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":185,"threads_started":1}
I20260809 18:57:44.044752 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.027262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39819 (local address 127.16.188.194:33031)
0809 18:57:44.027930 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:44.027967 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:44.029597 (+ 1630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:44.030198 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:44.030206 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:44.030691 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:44.031213 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.031230 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.032157 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.032160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.033487 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.033499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.034283 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.034288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.034475 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.035155 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:44.035190 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:44.037825 (+ 2635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:44.040756 (+ 2931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:44.040764 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:44.040779 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:44.041343 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:44.041686 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:44.041690 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:44.041693 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:44.041906 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:44.042360 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:44.042366 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:44.042729 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 18:57:44.042996 (+ 267us) client_negotiation.cc:240] Negotiation successful
0809 18:57:44.043476 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":264,"threads_started":1}
I20260809 18:57:44.046217 1240 heartbeater.cc:347] Connected to a master server at 127.16.188.254:39819
I20260809 18:57:44.046522 1240 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:44.047272 1240 heartbeater.cc:511] Master 127.16.188.254:39819 requested a full tablet report, sending...
I20260809 18:57:44.048725 715 ts_manager.cc:194] Registered new tserver with Master: 3e0199d377194e83a0979fc554bf4723 (127.16.188.194:37779)
I20260809 18:57:44.049580 715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:33031
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:57:44.090483 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39819
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:45335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:57:44.416102 1249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:57:44.416400 1249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:57:44.416548 1249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:57:44.423796 1249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:57:44.423908 1249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:57:44.424049 1249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:57:44.433514 1249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:45335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:39819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:57:44.434808 1249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:57:44.436049 1249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:57:44.448530 1257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:44.448469 1258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:57:44.448508 1261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:57:44.449421 1249 server_base.cc:1034] running on GCE node
I20260809 18:57:44.449986 1249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:57:44.450887 1249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:57:44.452070 1249 hybrid_clock.cc:648] HybridClock initialized: now 1786301864452009 us; error 53 us; skew 500 ppm
I20260809 18:57:44.452338 1249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:57:44 dist-test-slave-266d krb5kdc[640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301864, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:57:44.455169 1249 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:57:44.456558 1249 webserver.cc:460] Webserver started at http://127.16.188.195:44687/ using document root <none> and password file <none>
I20260809 18:57:44.457221 1249 fs_manager.cc:359] Metadata directory not provided
I20260809 18:57:44.457338 1249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:57:44.457624 1249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:57:44.460384 1249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "9c73848f78b54fc38d2e4de914eca1da"
format_stamp: "Formatted at 2026-08-09 18:57:44 on dist-test-slave-266d"
server_key: "bf99373f49a387b11996d87420779566"
server_key_iv: "13be59aa08396d9984601bb575c9e5ee"
server_key_version: "encryptionkey@0"
I20260809 18:57:44.461158 1249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "9c73848f78b54fc38d2e4de914eca1da"
format_stamp: "Formatted at 2026-08-09 18:57:44 on dist-test-slave-266d"
server_key: "bf99373f49a387b11996d87420779566"
server_key_iv: "13be59aa08396d9984601bb575c9e5ee"
server_key_version: "encryptionkey@0"
I20260809 18:57:44.465812 1249 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 18:57:44.468910 1275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:44.470111 1249 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 18:57:44.470261 1249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "9c73848f78b54fc38d2e4de914eca1da"
format_stamp: "Formatted at 2026-08-09 18:57:44 on dist-test-slave-266d"
server_key: "bf99373f49a387b11996d87420779566"
server_key_iv: "13be59aa08396d9984601bb575c9e5ee"
server_key_version: "encryptionkey@0"
I20260809 18:57:44.470433 1249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:57:44.502815 1249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:57:44.506683 1249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:57:44.506964 1249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:57:44.507841 1249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:57:44.509142 1249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:57:44.509227 1249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:44.509359 1249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:57:44.509419 1249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:57:44.533600 1024 heartbeater.cc:503] Master 127.16.188.254:39819 was elected leader, sending a full tablet report...
I20260809 18:57:44.542181 1249 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:34745
I20260809 18:57:44.542222 1458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:34745 every 8 connection(s)
I20260809 18:57:44.543380 1249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:57:44.544548 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 1249
I20260809 18:57:44.544734 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:57:44.545334 17139 external_mini_cluster.cc:1428] Setting key 95b31d156389ad9b33bcf25e0a5dbf4c
Aug 09 18:57:44 dist-test-slave-266d krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301864, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:57:44.561825 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.546012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:40567 (local address 127.16.188.254:39819)
0809 18:57:44.546483 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.546489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.547487 (+ 998us) server_negotiation.cc:407] Connection header received
0809 18:57:44.549403 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.549407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.549471 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.549552 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:44.550992 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.551760 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.553222 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.553606 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.553693 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.556693 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:44.556698 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:44.556701 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:44.556733 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:44.559021 (+ 2288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.559665 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.559671 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.559674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.559827 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.560213 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.560217 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.560218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.560470 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:44.560608 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.561240 (+ 632us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.561448 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":206,"threads_started":1}
I20260809 18:57:44.562652 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.546604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:39819 (local address 127.16.188.195:40567)
0809 18:57:44.547350 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:44.547395 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:44.549165 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:44.549739 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:44.549746 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:44.550279 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:57:44.550855 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.550873 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.551896 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.551900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.553111 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.553130 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.553770 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.553775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.553972 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.554518 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:57:44.554543 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:57:44.556507 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:57:44.559159 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:44.559168 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:44.559182 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:44.559557 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:44.559927 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:57:44.559932 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:57:44.559936 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:57:44.560108 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:57:44.560595 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:57:44.560603 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:57:44.560893 (+ 290us) client_negotiation.cc:769] Sending connection context
0809 18:57:44.561139 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 18:57:44.561603 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":314,"threads_started":1}
I20260809 18:57:44.563742 1459 heartbeater.cc:347] Connected to a master server at 127.16.188.254:39819
I20260809 18:57:44.563982 1459 heartbeater.cc:464] Registering TS with master...
I20260809 18:57:44.564620 1459 heartbeater.cc:511] Master 127.16.188.254:39819 requested a full tablet report, sending...
I20260809 18:57:44.565860 715 ts_manager.cc:194] Registered new tserver with Master: 9c73848f78b54fc38d2e4de914eca1da (127.16.188.195:34745)
I20260809 18:57:44.566628 715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:40567
I20260809 18:57:44.572193 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:57:44.587543 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.576778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38626 (local address 127.16.188.254:39819)
0809 18:57:44.576921 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.576925 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.577333 (+ 408us) server_negotiation.cc:407] Connection header received
0809 18:57:44.577454 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.577457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.577514 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.577586 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:44.578892 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.579546 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.580683 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.581067 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.581187 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.583230 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:44.583235 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:44.583238 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:44.583267 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:44.585512 (+ 2245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.586090 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.586093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.586095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.586202 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.586467 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.586469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.586471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.586757 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:44.586946 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.587182 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.587335 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:57:44.591240 715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:57:44.598007 715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:57:44.633410 1484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.610095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37779 (local address 127.0.0.1:47684)
0809 18:57:44.622352 (+ 12257us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:44.622375 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:44.622495 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:44.626390 (+ 3895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:44.626395 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:44.626425 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:44.626812 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.626823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.628449 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.628454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.630550 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.630563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.632374 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.632381 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.632588 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.632651 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 18:57:44.632796 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 18:57:44.632980 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12124,"thread_start_us":12484,"threads_started":1}
I20260809 18:57:44.633702 1496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.611601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58074 (local address 127.16.188.193:41885)
0809 18:57:44.624699 (+ 13098us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.624708 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.624740 (+ 32us) server_negotiation.cc:407] Connection header received
0809 18:57:44.624855 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.624863 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.625147 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.625351 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:44.626483 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.628006 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.630877 (+ 2871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.632194 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.632361 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.632488 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.633212 (+ 724us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.633372 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12898,"thread_start_us":14606,"threads_started":1}
I20260809 18:57:44.633703 1492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.610370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.16.188.194:37779)
0809 18:57:44.625835 (+ 15465us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.625843 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.625870 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:57:44.625963 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.625970 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.626183 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.626381 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:44.627000 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.628327 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.630685 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.632137 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.632311 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.632488 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.633298 (+ 810us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.633438 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15291,"thread_start_us":16199,"threads_started":1}
I20260809 18:57:44.634457 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.611197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:41885 (local address 127.0.0.1:58074)
0809 18:57:44.622494 (+ 11297us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:44.622513 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:44.622636 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:44.625637 (+ 3001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:44.625645 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:44.625679 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:44.626084 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.626096 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.628126 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.628132 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.630718 (+ 2586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.630734 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.632632 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.632637 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.632789 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.632821 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 18:57:44.632908 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 18:57:44.633029 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11165,"thread_start_us":10991,"threads_started":1}
I20260809 18:57:44.636195 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.609471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:34745 (local address 127.0.0.1:43434)
0809 18:57:44.610165 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:44.610215 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:44.610375 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:44.629973 (+ 19598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:44.629978 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:44.630003 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:44.630429 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.630440 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.631815 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.631820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.633645 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.633660 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.635461 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.635467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.635631 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.635661 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 18:57:44.635750 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:57:44.635883 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":960,"threads_started":1}
I20260809 18:57:44.636328 1487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.610130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43434 (local address 127.16.188.195:34745)
0809 18:57:44.629428 (+ 19298us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.629436 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.629469 (+ 33us) server_negotiation.cc:407] Connection header received
0809 18:57:44.629556 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.629563 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.629769 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.629962 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:44.630613 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.631681 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.634107 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.635273 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.635455 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.635623 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.635826 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.635976 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19113,"thread_start_us":20014,"threads_started":1}
I20260809 18:57:44.637916 906 tablet_service.cc:1467] Processing CreateTablet for tablet 89f99d7790dc42adb17fedc5a743d0b5 (DEFAULT_TABLE table=test-table [id=3a0cb6f1271a4ac6826a68b6a9986b64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:44.637921 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 89f99d7790dc42adb17fedc5a743d0b5 (DEFAULT_TABLE table=test-table [id=3a0cb6f1271a4ac6826a68b6a9986b64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:44.639514 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f99d7790dc42adb17fedc5a743d0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:44.639541 906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f99d7790dc42adb17fedc5a743d0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:44.639376 1341 tablet_service.cc:1467] Processing CreateTablet for tablet 89f99d7790dc42adb17fedc5a743d0b5 (DEFAULT_TABLE table=test-table [id=3a0cb6f1271a4ac6826a68b6a9986b64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:57:44.640561 1341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f99d7790dc42adb17fedc5a743d0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:57:44.652822 1498 tablet_bootstrap.cc:492] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: Bootstrap starting.
I20260809 18:57:44.654748 1504 tablet_bootstrap.cc:492] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: Bootstrap starting.
I20260809 18:57:44.656657 1498 tablet_bootstrap.cc:654] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:44.658012 1498 log.cc:824] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:44.658237 1504 tablet_bootstrap.cc:654] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:44.659291 1504 log.cc:824] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:44.659566 1502 tablet_bootstrap.cc:492] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: Bootstrap starting.
I20260809 18:57:44.662021 1504 tablet_bootstrap.cc:492] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: No bootstrap required, opened a new log
I20260809 18:57:44.662266 1504 ts_tablet_manager.cc:1397] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260809 18:57:44.662497 1498 tablet_bootstrap.cc:492] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: No bootstrap required, opened a new log
I20260809 18:57:44.662770 1498 ts_tablet_manager.cc:1397] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260809 18:57:44.663434 1502 tablet_bootstrap.cc:654] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: Neither blocks nor log segments found. Creating new log.
I20260809 18:57:44.664595 1502 log.cc:824] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: Log is configured to *not* fsync() on all Append() calls
I20260809 18:57:44.667475 1502 tablet_bootstrap.cc:492] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: No bootstrap required, opened a new log
I20260809 18:57:44.667712 1502 ts_tablet_manager.cc:1397] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 18:57:44.669301 1504 raft_consensus.cc:348] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.669623 1504 raft_consensus.cc:374] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:44.669720 1504 raft_consensus.cc:729] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e0199d377194e83a0979fc554bf4723, State: Initialized, Role: FOLLOWER
I20260809 18:57:44.670252 1504 consensus_queue.cc:260] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.671649 1240 heartbeater.cc:503] Master 127.16.188.254:39819 was elected leader, sending a full tablet report...
I20260809 18:57:44.672308 1504 ts_tablet_manager.cc:1428] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260809 18:57:44.673125 1498 raft_consensus.cc:348] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.673629 1498 raft_consensus.cc:374] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:44.673729 1498 raft_consensus.cc:729] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c73848f78b54fc38d2e4de914eca1da, State: Initialized, Role: FOLLOWER
I20260809 18:57:44.674386 1498 consensus_queue.cc:260] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.676100 1498 ts_tablet_manager.cc:1428] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260809 18:57:44.676239 1459 heartbeater.cc:503] Master 127.16.188.254:39819 was elected leader, sending a full tablet report...
I20260809 18:57:44.677250 1502 raft_consensus.cc:348] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.677645 1502 raft_consensus.cc:374] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:57:44.677743 1502 raft_consensus.cc:729] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a6d4f80b8af44009f3dae4397ca78cd, State: Initialized, Role: FOLLOWER
I20260809 18:57:44.678251 1502 consensus_queue.cc:260] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.679627 1502 ts_tablet_manager.cc:1428] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260809 18:57:44.681460 1515 raft_consensus.cc:482] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:57:44.681699 1515 raft_consensus.cc:504] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.683743 1515 leader_election.cc:288] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c73848f78b54fc38d2e4de914eca1da (127.16.188.195:34745), 3e0199d377194e83a0979fc554bf4723 (127.16.188.194:37779)
I20260809 18:57:44.690198 1487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.684095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:42857 (local address 127.16.188.195:34745)
0809 18:57:44.684420 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.684427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.684934 (+ 507us) server_negotiation.cc:407] Connection header received
0809 18:57:44.685131 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.685136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.685209 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.685303 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:44.685866 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.686651 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.688440 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.689305 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.689421 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.689475 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.689833 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.689956 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260809 18:57:44.690264 1492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.683744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:36463 (local address 127.16.188.194:37779)
0809 18:57:44.683951 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.683958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.685210 (+ 1252us) server_negotiation.cc:407] Connection header received
0809 18:57:44.685368 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.685373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.685441 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.685527 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:57:44.686134 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.686906 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.688607 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.689438 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.689576 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.689646 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.689926 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.690050 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:57:44.690379 1516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.683554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37779 (local address 127.16.188.193:36463)
0809 18:57:44.685055 (+ 1501us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:44.685072 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:44.685249 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:44.685566 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:44.685569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:44.685593 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:44.685980 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.685993 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.687038 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.687041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.688462 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.688477 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.689635 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.689640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.689760 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.689801 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 18:57:44.689888 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 18:57:44.690006 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1388,"mutex_wait_us":481,"thread_start_us":446,"threads_started":1}
I20260809 18:57:44.690533 1518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.683549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:34745 (local address 127.16.188.193:42857)
0809 18:57:44.684816 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0809 18:57:44.684838 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:57:44.684984 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:57:44.685313 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:57:44.685318 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:57:44.685345 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:57:44.685730 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.685740 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.686773 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.686779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.688291 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:57:44.688304 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.689498 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.689504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:57:44.689679 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.689710 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 18:57:44.689785 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 18:57:44.689877 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1125,"thread_start_us":1232,"threads_started":1}
I20260809 18:57:44.691265 1169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f99d7790dc42adb17fedc5a743d0b5" candidate_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0199d377194e83a0979fc554bf4723" is_pre_election: true
I20260809 18:57:44.691375 1372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f99d7790dc42adb17fedc5a743d0b5" candidate_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c73848f78b54fc38d2e4de914eca1da" is_pre_election: true
I20260809 18:57:44.691690 1169 raft_consensus.cc:2454] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a6d4f80b8af44009f3dae4397ca78cd in term 0.
I20260809 18:57:44.691817 1372 raft_consensus.cc:2454] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a6d4f80b8af44009f3dae4397ca78cd in term 0.
I20260809 18:57:44.692286 831 leader_election.cc:302] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e0199d377194e83a0979fc554bf4723, 7a6d4f80b8af44009f3dae4397ca78cd; no voters:
I20260809 18:57:44.692615 1515 raft_consensus.cc:2781] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:57:44.692740 1515 raft_consensus.cc:482] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:57:44.692842 1515 raft_consensus.cc:3037] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:44.694932 1515 raft_consensus.cc:504] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.695513 1515 leader_election.cc:288] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [CANDIDATE]: Term 1 election: Requested vote from peers 9c73848f78b54fc38d2e4de914eca1da (127.16.188.195:34745), 3e0199d377194e83a0979fc554bf4723 (127.16.188.194:37779)
I20260809 18:57:44.695852 1372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f99d7790dc42adb17fedc5a743d0b5" candidate_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c73848f78b54fc38d2e4de914eca1da"
I20260809 18:57:44.695941 1169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f99d7790dc42adb17fedc5a743d0b5" candidate_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0199d377194e83a0979fc554bf4723"
I20260809 18:57:44.696007 1372 raft_consensus.cc:3037] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:44.696125 1169 raft_consensus.cc:3037] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:57:44.698205 1372 raft_consensus.cc:2454] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a6d4f80b8af44009f3dae4397ca78cd in term 1.
I20260809 18:57:44.698362 1169 raft_consensus.cc:2454] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a6d4f80b8af44009f3dae4397ca78cd in term 1.
I20260809 18:57:44.698581 827 leader_election.cc:302] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a6d4f80b8af44009f3dae4397ca78cd, 9c73848f78b54fc38d2e4de914eca1da; no voters:
I20260809 18:57:44.698892 1515 raft_consensus.cc:2781] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:57:44.699329 1515 raft_consensus.cc:686] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 1 LEADER]: Becoming Leader. State: Replica: 7a6d4f80b8af44009f3dae4397ca78cd, State: Running, Role: LEADER
I20260809 18:57:44.699863 1515 consensus_queue.cc:237] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } }
I20260809 18:57:44.704353 715 catalog_manager.cc:5495] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a6d4f80b8af44009f3dae4397ca78cd (127.16.188.193). New cstate: current_term: 1 leader_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a6d4f80b8af44009f3dae4397ca78cd" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 } health_report { overall_health: UNKNOWN } } }
I20260809 18:57:44.730458 1496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.725780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58076 (local address 127.16.188.193:41885)
0809 18:57:44.725942 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.725947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.725962 (+ 15us) server_negotiation.cc:407] Connection header received
0809 18:57:44.726037 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.726041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.726123 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.726235 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:57:44.726514 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.727194 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.728584 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.728970 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.729051 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.729490 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:57:44.729973 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:57:44.730073 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.730141 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.730202 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:57:44.738165 1372 raft_consensus.cc:1261] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 1 FOLLOWER]: Refusing update from remote peer 7a6d4f80b8af44009f3dae4397ca78cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:44.738170 1169 raft_consensus.cc:1261] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 1 FOLLOWER]: Refusing update from remote peer 7a6d4f80b8af44009f3dae4397ca78cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:57:44.739117 1515 consensus_queue.cc:1035] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e0199d377194e83a0979fc554bf4723" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:44.739405 1520 consensus_queue.cc:1035] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c73848f78b54fc38d2e4de914eca1da" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:57:44.750948 1530 mvcc.cc:205] Tried to move back new op lower bound from 7316692437957894144 to 7316692437814280192. Current Snapshot: MvccSnapshot[applied={T|T < 7316692437957894144}]
I20260809 18:57:44.764324 712 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:44.764628 712 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:57:44.768291 712 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b540e23d338406fb32f0037c569fd4c: Sending DeleteTablet for 3 replicas of tablet 89f99d7790dc42adb17fedc5a743d0b5
I20260809 18:57:44.769317 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f99d7790dc42adb17fedc5a743d0b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:44 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:47684
I20260809 18:57:44.769321 1341 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f99d7790dc42adb17fedc5a743d0b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:44 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:43434
I20260809 18:57:44.769937 906 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f99d7790dc42adb17fedc5a743d0b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:57:44 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:58074
I20260809 18:57:44.770102 1541 tablet_replica.cc:330] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: stopping tablet replica
I20260809 18:57:44.770483 1541 raft_consensus.cc:2229] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:44.771018 1541 raft_consensus.cc:2258] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:44.773211 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 803
I20260809 18:57:44.773221 1541 ts_tablet_manager.cc:1905] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:44.780172 1541 ts_tablet_manager.cc:1918] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:44.780328 1541 log.cc:1196] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/89f99d7790dc42adb17fedc5a743d0b5
I20260809 18:57:44.780834 1541 ts_tablet_manager.cc:1939] T 89f99d7790dc42adb17fedc5a743d0b5 P 3e0199d377194e83a0979fc554bf4723: Deleting consensus metadata
I20260809 18:57:44.786863 1546 tablet_replica.cc:330] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: stopping tablet replica
I20260809 18:57:44.787413 1546 raft_consensus.cc:2229] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:57:44.788184 1546 raft_consensus.cc:2258] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:44.790053 695 catalog_manager.cc:4841] TS 3e0199d377194e83a0979fc554bf4723 (127.16.188.194:37779): tablet 89f99d7790dc42adb17fedc5a743d0b5 (table test-table [id=3a0cb6f1271a4ac6826a68b6a9986b64]) successfully deleted
I20260809 18:57:44.790721 1546 ts_tablet_manager.cc:1905] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 18:57:44 dist-test-slave-266d krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:57:44.797508 1542 tablet_replica.cc:330] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: stopping tablet replica
I20260809 18:57:44.797982 1542 raft_consensus.cc:2229] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:57:44.798545 1542 raft_consensus.cc:2258] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:57:44.799858 1546 ts_tablet_manager.cc:1918] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:44.800072 1546 log.cc:1196] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/89f99d7790dc42adb17fedc5a743d0b5
I20260809 18:57:44.800655 1546 ts_tablet_manager.cc:1939] T 89f99d7790dc42adb17fedc5a743d0b5 P 7a6d4f80b8af44009f3dae4397ca78cd: Deleting consensus metadata
I20260809 18:57:44.800877 1542 ts_tablet_manager.cc:1905] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:57:44.802567 688 catalog_manager.cc:4841] TS 7a6d4f80b8af44009f3dae4397ca78cd (127.16.188.193:41885): tablet 89f99d7790dc42adb17fedc5a743d0b5 (table test-table [id=3a0cb6f1271a4ac6826a68b6a9986b64]) successfully deleted
I20260809 18:57:44.802719 1496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.774689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58084 (local address 127.16.188.193:41885)
0809 18:57:44.774859 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.774865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.781514 (+ 6649us) server_negotiation.cc:407] Connection header received
0809 18:57:44.781775 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.781781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.781891 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.781965 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:44.783727 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.785013 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.786885 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.787594 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.787684 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.794774 (+ 7090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:44.794786 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:44.794803 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:44.794858 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:44.798979 (+ 4121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.799846 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.799855 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.799858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.800043 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.800536 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.800541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.800545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.800997 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:44.801357 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.801963 (+ 606us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.802204 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:57:44.804178 1016 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:44.807490 1542 ts_tablet_manager.cc:1918] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:57:44.807644 1542 log.cc:1196] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/89f99d7790dc42adb17fedc5a743d0b5
I20260809 18:57:44.808116 1542 ts_tablet_manager.cc:1939] T 89f99d7790dc42adb17fedc5a743d0b5 P 9c73848f78b54fc38d2e4de914eca1da: Deleting consensus metadata
I20260809 18:57:44.809549 688 catalog_manager.cc:4841] TS 9c73848f78b54fc38d2e4de914eca1da (127.16.188.195:34745): tablet 89f99d7790dc42adb17fedc5a743d0b5 (table test-table [id=3a0cb6f1271a4ac6826a68b6a9986b64]) successfully deleted
I20260809 18:57:44.907752 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 803
I20260809 18:57:44.931988 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 1031
Aug 09 18:57:44 dist-test-slave-266d krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:57:44.946203 1492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:44.932704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47694 (local address 127.16.188.194:37779)
0809 18:57:44.932880 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:44.932886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:44.932929 (+ 43us) server_negotiation.cc:407] Connection header received
0809 18:57:44.933169 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:44.933175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:44.933246 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:44.933342 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:44.934541 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.935257 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.936477 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:44.936877 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:44.936984 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:44.941020 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:44.941034 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:44.941051 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:44.941114 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:44.943642 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.944238 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.944244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.944247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.944367 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:44.944657 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:44.944660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:44.944662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:44.945005 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:44.945428 (+ 423us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:44.945587 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 18:57:44.945825 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 18:57:44.946909 1233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:45.033470 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 1031
I20260809 18:57:45.055572 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 1249
Aug 09 18:57:45 dist-test-slave-266d krb5kdc[640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:57:45.069592 1487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:57:45.056277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43448 (local address 127.16.188.195:34745)
0809 18:57:45.056496 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 18:57:45.056501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:57:45.056520 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:57:45.056650 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:57:45.056654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:57:45.056720 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:57:45.056802 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:57:45.058049 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:45.058766 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:45.059867 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:57:45.060227 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:57:45.060321 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:57:45.064550 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:57:45.064564 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:57:45.064582 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:57:45.064624 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:57:45.067258 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:45.067856 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:45.067864 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:45.067866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:45.067994 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:57:45.068251 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:57:45.068254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:57:45.068256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:57:45.068587 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:57:45.068815 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 18:57:45.069003 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 18:57:45.069311 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 18:57:45.070209 1452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:45.156819 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 1249
I20260809 18:57:45.178021 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 659
I20260809 18:57:45.179190 756 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:57:45.284968 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 659
2026-08-09T18:57:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4298 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:57:45 dist-test-slave-266d krb5kdc[1556](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:57:45 dist-test-slave-266d krb5kdc[1556](info): set up 2 sockets
Aug 09 18:57:45 dist-test-slave-266d krb5kdc[1556](info): commencing operation
krb5kdc: starting...
W20260809 18:57:46.507912 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:57:46 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:57:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:57:46Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.16.188.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.16.188.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/rangeradmin_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/rangeradmin_127.16.188.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.16.188.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.16.188.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/rangerlookup_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/rangerlookup_127.16.188.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.188.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.16.188.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/HTTP_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/HTTP_127.16.188.212@KRBTEST.COM.keytab.
I20260809 18:57:46.866464 17139 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskr97ygv/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/postgres -l logfile start
2026-08-09 18:57:49.182 UTC [1604] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 18:57:49.182 UTC [1604] LOG: listening on IPv4 address "127.16.188.212", port 51247
2026-08-09 18:57:49.185 UTC [1604] LOG: listening on Unix socket "/tmp/.s.PGSQL.51247"
2026-08-09 18:57:49.206 UTC [1608] LOG: database system was shut down at 2026-08-09 18:57:47 UTC
2026-08-09 18:57:49.210 UTC [1604] LOG: database system is ready to accept connections
I20260809 18:57:50.288388 17139 mini_postgres.cc:96] Postgres bound to 51247
2026-08-09 18:57:50.312 UTC [1624] FATAL: database "slave" does not exist
127.16.188.212:51247 - accepting connections
I20260809 18:57:50.313521 17139 mini_ranger.cc:161] Starting Ranger...
I20260809 18:57:50.344853 17139 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 18:57:50.764115 17139 mini_ranger.cc:87] Created ranger Postgres database
I20260809 18:57:50.764276 17139 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-admin
2026-08-09 18:57:51,093 [I] DB FLAVOR :POSTGRES
2026-08-09 18:57:51,094 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:57:51,094 [I] Checking connection..
2026-08-09 18:57:51,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 18:57:51,376 [I] Checking connection passed.
2026-08-09 18:57:51,376 [I] --------- Verifying version history table ---------
2026-08-09 18:57:51,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:57:51,643 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:57:51,644 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:57:51,881 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:57:51,881 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 18:57:51,881 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 18:57:52.129 UTC [1741] WARNING: there is no transaction in progress
2026-08-09 18:57:52,135 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 18:57:52,136 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:57:52,382 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 18:57:52,382 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:57:52,383 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 18:57:52,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 18:57:52,868 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-266d.c.gcp-upstream.internal','N') ;"
2026-08-09 18:57:53,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:57:53,379 [I] Table x_portal_user does not exist in database ranger
2026-08-09 18:57:53,379 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:57:53,646 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 18:57:53,646 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:57:53,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:57:54,138 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 18:57:54,139 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 18:57:55.029 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.045 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.060 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.074 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.089 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.104 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.157 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.163 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.175 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.184 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.193 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.204 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.213 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.219 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.224 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55.230 UTC [1930] WARNING: there is no transaction in progress
2026-08-09 18:57:55,777 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 18:57:55,777 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 18:57:56,002 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 18:57:56,003 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:57:56,260 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 18:57:56,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:57:56,515 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 18:57:56,515 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:57:56,766 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:57:57,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-266d.c.gcp-upstream.internal';"
2026-08-09 18:57:57,249 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 18:57:57,250 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 18:57:57,510 [I] DB_PATCHES have already been applied
I20260809 18:57:57.516196 17139 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-admin:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskr97ygv/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 18:57:57.516297 17139 mini_ranger.cc:193] Using host: 127.16.188.212
I20260809 18:57:57.536217 17139 mini_ranger.cc:227] Ranger admin URL: http://127.16.188.212:49423
Aug 09, 2026 6:57:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:57:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:57:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:57:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:57:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:57:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:57:58 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 18:57:58.754123 17139 mini_ranger.cc:160] Time spent starting Ranger: real 8.441s user 0.001s sys 0.059s
Aug 09, 2026 6:58:18 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:58:18 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 6:58:18 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:58:18 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:58:19 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 18:58:20.264213 17139 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.16.188.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.16.188.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/rangerkms_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/rangerkms_127.16.188.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.188.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.16.188.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.188.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/HTTP_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.188.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/HTTP_127.16.188.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 18:58:20 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301900, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 18:58:20.472950 17139 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 18:58:20.497773 17139 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 18:58:21.247445 17139 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 18:58:21.247583 17139 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms
I20260809 18:58:21.247749 17139 mini_ranger_kms.cc:227] Using postgres at 127.16.188.212:51247
2026-08-09 18:58:21,783 [I] DB FLAVOR :POSTGRES
2026-08-09 18:58:21,784 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:58:21,784 [I] Checking connection
2026-08-09 18:58:21,784 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 18:58:22,025 [I] connection success
2026-08-09 18:58:22,025 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 18:58:22,025 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 18:58:22,025 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 18:58:22,258 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 18:58:22,259 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:58:22,259 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 18:58:22,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:51247/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 18:58:22,519 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 18:58:22.970283 17139 mini_ranger_kms.cc:310] Created kms service
I20260809 18:58:23.169687 17139 mini_ranger_kms.cc:326] Created kudu user
I20260809 18:58:23.212474 17139 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 18:58:23 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301900, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:58:23.605257 17139 mini_ranger_kms.cc:384] Added ranger policy
I20260809 18:58:23.606504 17139 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms:/tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 18:58:23.606565 17139 mini_ranger_kms.cc:240] Using host: 127.16.188.212
I20260809 18:58:23.635448 17139 mini_ranger_kms.cc:276] Ranger KMS PID: 2228
I20260809 18:58:23.635651 17139 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.16.188.212:50993
Aug 09, 2026 6:58:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:58:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:58:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:58:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:58:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:58:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 18:58:26 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301906, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.188.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:26.348783 17139 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.876s user 0.133s sys 0.433s
I20260809 18:58:26.349406 17139 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 18:58:26.349682 17139 mini_ranger_kms.cc:401] 127.16.188.212:50993/kms/v1/keys
Aug 09 18:58:26 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301906, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.188.212@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
Aug 09 18:58:27 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301906, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.188.212@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
Aug 09 18:58:29 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:58:29.695034 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:45159
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:43375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:45159
--ranger_config_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:50993/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:58:30.077304 2313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:58:30.077639 2313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:58:30.077833 2313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:58:30.085449 2313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:58:30.085554 2313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:58:30.085634 2313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:58:30.085707 2313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:58:30.085772 2313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:58:30.096246 2313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:43375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/wal
--ranger_kms_url=127.16.188.212:50993/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:45159
--ranger_config_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:45159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:58:30.097604 2313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:58:30.098905 2313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:58:30.112212 2333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:30.112258 2325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:30.112142 2327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:58:30.112993 2313 server_base.cc:1034] running on GCE node
I20260809 18:58:30.113813 2313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:58:30.115232 2313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:58:30.116425 2313 hybrid_clock.cc:648] HybridClock initialized: now 1786301910116384 us; error 32 us; skew 500 ppm
I20260809 18:58:30.116743 2313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:58:30 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301910, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:30.124811 2313 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:58:30.126607 2313 webserver.cc:460] Webserver started at http://127.16.188.254:35897/ using document root <none> and password file <none>
I20260809 18:58:30.127337 2313 fs_manager.cc:359] Metadata directory not provided
I20260809 18:58:30.127455 2313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:58:30.127749 2313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:58:30 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301910, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:58:30.179188 2313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "825ba56e4c754a63bbc23807b119dfeb"
format_stamp: "Formatted at 2026-08-09 18:58:30 on dist-test-slave-266d"
server_key: "cc38389739348ee7b2da9dccae2862cb"
server_key_iv: "7b39a52cec74c48ea0bc2120291f0879"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:30.180102 2313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "825ba56e4c754a63bbc23807b119dfeb"
format_stamp: "Formatted at 2026-08-09 18:58:30 on dist-test-slave-266d"
server_key: "cc38389739348ee7b2da9dccae2862cb"
server_key_iv: "7b39a52cec74c48ea0bc2120291f0879"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:30.186092 2313 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260809 18:58:30.206228 2343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:30.207713 2313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 18:58:30.207916 2313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "825ba56e4c754a63bbc23807b119dfeb"
format_stamp: "Formatted at 2026-08-09 18:58:30 on dist-test-slave-266d"
server_key: "cc38389739348ee7b2da9dccae2862cb"
server_key_iv: "7b39a52cec74c48ea0bc2120291f0879"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:30.208133 2313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:58:30.233212 2313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:58:30.237363 2313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:58:30.237661 2313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:58:30.263236 2313 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:45159
I20260809 18:58:30.263222 2410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:45159 every 8 connection(s)
I20260809 18:58:30.264894 2313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:58:30.267817 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 2313
I20260809 18:58:30.268041 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:58:30.268882 17139 external_mini_cluster.cc:1428] Setting key e61212bd131ea4cd98f0b7e6840248e1
I20260809 18:58:30.270093 2411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:58:30.285215 2411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb: Bootstrap starting.
I20260809 18:58:30.289748 2411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb: Neither blocks nor log segments found. Creating new log.
I20260809 18:58:30.290859 2411 log.cc:824] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb: Log is configured to *not* fsync() on all Append() calls
I20260809 18:58:30.294108 2411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb: No bootstrap required, opened a new log
Aug 09 18:58:30 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:58:30.303114 2411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825ba56e4c754a63bbc23807b119dfeb" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45159 } }
I20260809 18:58:30.303768 2411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:58:30.303949 2411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825ba56e4c754a63bbc23807b119dfeb, State: Initialized, Role: FOLLOWER
I20260809 18:58:30.304802 2411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825ba56e4c754a63bbc23807b119dfeb" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45159 } }
I20260809 18:58:30.305269 2411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:58:30.305500 2411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:58:30.305747 2411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:58:30.308915 2411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825ba56e4c754a63bbc23807b119dfeb" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45159 } }
I20260809 18:58:30.309435 2411 leader_election.cc:302] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 825ba56e4c754a63bbc23807b119dfeb; no voters:
I20260809 18:58:30.310060 2411 leader_election.cc:288] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:58:30.310184 2421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:58:30.310472 2416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:30.271079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53294 (local address 127.16.188.254:45159)
0809 18:58:30.281678 (+ 10599us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:30.281690 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:30.285346 (+ 3656us) server_negotiation.cc:407] Connection header received
0809 18:58:30.288530 (+ 3184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:30.288559 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:30.289019 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:30.289500 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:30.290993 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:30.292752 (+ 1759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:30.294541 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:30.295536 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:30.295703 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:30.300471 (+ 4768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:30.300482 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:30.300502 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:30.300556 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:30.305225 (+ 4669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:30.306126 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:30.306134 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:30.306143 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:30.306335 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:30.306818 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:30.306823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:30.306826 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:30.307588 (+ 762us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:30.307909 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:30.308379 (+ 470us) server_negotiation.cc:299] Negotiation successful
0809 18:58:30.309025 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10358,"thread_start_us":10088,"threads_started":1}
I20260809 18:58:30.314883 2421 raft_consensus.cc:686] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [term 1 LEADER]: Becoming Leader. State: Replica: 825ba56e4c754a63bbc23807b119dfeb, State: Running, Role: LEADER
I20260809 18:58:30.315591 2421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825ba56e4c754a63bbc23807b119dfeb" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45159 } }
I20260809 18:58:30.318976 2411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:58:30.323026 2424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "825ba56e4c754a63bbc23807b119dfeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825ba56e4c754a63bbc23807b119dfeb" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45159 } } }
I20260809 18:58:30.323398 2424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [sys.catalog]: This master's current role is: LEADER
I20260809 18:58:30.325268 2423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 825ba56e4c754a63bbc23807b119dfeb. Latest consensus state: current_term: 1 leader_uuid: "825ba56e4c754a63bbc23807b119dfeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825ba56e4c754a63bbc23807b119dfeb" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 45159 } } }
I20260809 18:58:30.325649 2433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:58:30.325726 2423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb [sys.catalog]: This master's current role is: LEADER
I20260809 18:58:30.340832 2433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:58:30.351352 2411 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 18:58:30.375674 2433 catalog_manager.cc:1347] Generated new cluster ID: d99c688135254037803d4072426cfb62
I20260809 18:58:30.375912 2433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:58:30.412657 2433 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:58:30.414242 2433 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:58:30.420819 2433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb: Generated new TSK 0
I20260809 18:58:30.421650 2433 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:58:31.211028 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:50993/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45159
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:43375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:58:31 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301911, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 18:58:31.743515 2481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:58:31.743861 2481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:58:31.744105 2481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:58:31.753159 2481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:58:31.753412 2481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:58:31.753646 2481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:58:31.764971 2481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:43375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.16.188.212:50993/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:58:31.766520 2481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:58:31.767943 2481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:58:31.787741 2496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:31.794035 2497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:31.796270 2501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:58:31.797379 2481 server_base.cc:1034] running on GCE node
I20260809 18:58:31.798143 2481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:58:31.799212 2481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:58:31.800431 2481 hybrid_clock.cc:648] HybridClock initialized: now 1786301911800363 us; error 56 us; skew 500 ppm
I20260809 18:58:31.800858 2481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:58:31 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301911, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:31.805855 2481 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:58:31.809514 2481 webserver.cc:460] Webserver started at http://127.16.188.193:39355/ using document root <none> and password file <none>
I20260809 18:58:31.810427 2481 fs_manager.cc:359] Metadata directory not provided
I20260809 18:58:31.810563 2481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:58:31.811172 2481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:58:31 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301911, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:58:31.832839 2481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "dda568ec860043eca2c93065738f7298"
format_stamp: "Formatted at 2026-08-09 18:58:31 on dist-test-slave-266d"
server_key: "f401543fc8778c85da328ef6d91df75f"
server_key_iv: "5a43d7cede6c0e2f0905ed7afb46a488"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:31.833912 2481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "dda568ec860043eca2c93065738f7298"
format_stamp: "Formatted at 2026-08-09 18:58:31 on dist-test-slave-266d"
server_key: "f401543fc8778c85da328ef6d91df75f"
server_key_iv: "5a43d7cede6c0e2f0905ed7afb46a488"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:31.843175 2481 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.006s sys 0.003s
I20260809 18:58:31.861831 2512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:31.863425 2481 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260809 18:58:31.863651 2481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "dda568ec860043eca2c93065738f7298"
format_stamp: "Formatted at 2026-08-09 18:58:31 on dist-test-slave-266d"
server_key: "f401543fc8778c85da328ef6d91df75f"
server_key_iv: "5a43d7cede6c0e2f0905ed7afb46a488"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:31.863890 2481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:58:31.881866 2481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:58:31.887096 2481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:58:31.887570 2481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:58:31.889142 2481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:58:31.891340 2481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:58:31.891471 2481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:31.891662 2481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:58:31.891808 2481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:32.062371 2481 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:43065
I20260809 18:58:32.062418 2693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:43065 every 8 connection(s)
I20260809 18:58:32.064575 2481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:58:32.074810 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 2481
I20260809 18:58:32.075067 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:58:32.076155 17139 external_mini_cluster.cc:1428] Setting key de2b7e15e25da6aff018a4dcf337dd75
Aug 09 18:58:32 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301911, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
Aug 09 18:58:32 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301911, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:58:32.131151 2696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:32.068401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:43515 (local address 127.16.188.254:45159)
0809 18:58:32.091781 (+ 23380us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:32.091788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:32.098206 (+ 6418us) server_negotiation.cc:407] Connection header received
0809 18:58:32.102179 (+ 3973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:32.102186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:32.102276 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:32.102361 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:32.105415 (+ 3054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:32.106866 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:32.111785 (+ 4919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:32.112714 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:32.112832 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:32.121371 (+ 8539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:32.121378 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:32.121382 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:32.121454 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:32.126032 (+ 4578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:32.127598 (+ 1566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:32.127604 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:32.127607 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:32.127811 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:32.128446 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:32.128450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:32.128453 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:32.128918 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:32.129048 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:32.130339 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0809 18:58:32.130612 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23235,"thread_start_us":23043,"threads_started":1}
I20260809 18:58:32.133565 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:32.069344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45159 (local address 127.16.188.193:43515)
0809 18:58:32.098015 (+ 28671us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:32.098087 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:32.101817 (+ 3730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:32.103050 (+ 1233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:32.103062 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:32.103990 (+ 928us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:58:32.105173 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:32.105234 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:32.107189 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:32.107195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:32.109909 (+ 2714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:32.109925 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:32.113439 (+ 3514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:32.113447 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:32.113851 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:32.117339 (+ 3488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:58:32.117373 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:58:32.121071 (+ 3698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:58:32.126764 (+ 5693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:32.126783 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:32.126803 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:32.127455 (+ 652us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:32.127995 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:32.127999 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:32.128002 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:32.128317 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:32.129213 (+ 896us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:58:32.129221 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:58:32.129852 (+ 631us) client_negotiation.cc:769] Sending connection context
0809 18:58:32.131378 (+ 1526us) client_negotiation.cc:240] Negotiation successful
0809 18:58:32.131981 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28316,"thread_start_us":27997,"threads_started":1}
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
I20260809 18:58:32.135596 2694 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45159
I20260809 18:58:32.136185 2694 heartbeater.cc:464] Registering TS with master...
I20260809 18:58:32.137558 2694 heartbeater.cc:511] Master 127.16.188.254:45159 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
I20260809 18:58:32.140199 2365 ts_manager.cc:194] Registered new tserver with Master: dda568ec860043eca2c93065738f7298 (127.16.188.193:43065)
I20260809 18:58:32.142089 2365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:43515
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
W20260809 18:58:32.188282 17139 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.16.188.194: real 0.103s user 0.002s sys 0.021s
I20260809 18:58:32.189335 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:50993/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45159
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:43375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:58:32 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301911, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
W20260809 18:58:32.812620 2704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:58:32.813217 2704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:58:32.813547 2704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:58:32.826785 2704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:58:32.827008 2704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:58:32.827318 2704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:58:32.843334 2704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:43375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.16.188.212:50993/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:58:32.845369 2704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:58:32.847535 2704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:58:32.873871 2725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:32.874794 2723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:32.875402 2729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:58:32.876534 2704 server_base.cc:1034] running on GCE node
I20260809 18:58:32.877424 2704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:58:32.878898 2704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:58:32.880187 2704 hybrid_clock.cc:648] HybridClock initialized: now 1786301912880076 us; error 51 us; skew 500 ppm
I20260809 18:58:32.880645 2704 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:58:32 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301912, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:32.885301 2704 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:58:32.887406 2704 webserver.cc:460] Webserver started at http://127.16.188.194:40315/ using document root <none> and password file <none>
I20260809 18:58:32.888298 2704 fs_manager.cc:359] Metadata directory not provided
I20260809 18:58:32.888494 2704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:58:32.888927 2704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:58:32 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301912, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:58:32.909825 2704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "48a28e3b651f4e6982c5761575701de1"
format_stamp: "Formatted at 2026-08-09 18:58:32 on dist-test-slave-266d"
server_key: "657d7b88b5af4b6670fd821fce6342a5"
server_key_iv: "9ded21ede4247ecf17a6c223bb1cdc29"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:32.911448 2704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "48a28e3b651f4e6982c5761575701de1"
format_stamp: "Formatted at 2026-08-09 18:58:32 on dist-test-slave-266d"
server_key: "657d7b88b5af4b6670fd821fce6342a5"
server_key_iv: "9ded21ede4247ecf17a6c223bb1cdc29"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:32.920990 2704 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.006s sys 0.001s
I20260809 18:58:32.946202 2740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:32.947906 2704 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.004s sys 0.004s
I20260809 18:58:32.948136 2704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "48a28e3b651f4e6982c5761575701de1"
format_stamp: "Formatted at 2026-08-09 18:58:32 on dist-test-slave-266d"
server_key: "657d7b88b5af4b6670fd821fce6342a5"
server_key_iv: "9ded21ede4247ecf17a6c223bb1cdc29"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:32.948464 2704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:58:32.972790 2704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:58:32.978752 2704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:58:32.979199 2704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:58:32.981299 2704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:58:32.983667 2704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:58:32.983799 2704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:32.984021 2704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:58:32.984134 2704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:33.079474 2704 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:45765
I20260809 18:58:33.079510 2929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:45765 every 8 connection(s)
I20260809 18:58:33.082012 2704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:58:33.092038 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 2704
I20260809 18:58:33.092226 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:58:33.092875 17139 external_mini_cluster.cc:1428] Setting key 4f5751a29f85614c5ad7a835e449688f
Aug 09 18:58:33 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301912, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:58:33.125521 2938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.087532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:42335 (local address 127.16.188.254:45159)
0809 18:58:33.101657 (+ 14125us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:33.101663 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:33.102952 (+ 1289us) server_negotiation.cc:407] Connection header received
0809 18:58:33.105020 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:33.105026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:33.105186 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:33.105285 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:33.107437 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.108771 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.110972 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.111864 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.112135 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.116392 (+ 4257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:33.116400 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:33.116405 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:33.116475 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:33.121224 (+ 4749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:33.122351 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:33.122356 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:33.122359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:33.122544 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:33.123162 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:33.123167 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:33.123170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:33.123642 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:33.123790 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:33.124711 (+ 921us) server_negotiation.cc:299] Negotiation successful
0809 18:58:33.124987 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13935,"thread_start_us":13836,"threads_started":1}
I20260809 18:58:33.126644 2936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.086851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45159 (local address 127.16.188.194:42335)
0809 18:58:33.102329 (+ 15478us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:33.102390 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:33.104611 (+ 2221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:33.105825 (+ 1214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:33.105839 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:33.106438 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:58:33.107232 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.107256 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.108972 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.108977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.110804 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.110819 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.112209 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.112218 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.112483 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.113344 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:58:33.113373 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:58:33.116096 (+ 2723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:58:33.121365 (+ 5269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:33.121375 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:33.121392 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:33.122185 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:33.122673 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:33.122678 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:33.122681 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:33.123013 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:33.123786 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:58:33.123794 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:58:33.124218 (+ 424us) client_negotiation.cc:769] Sending connection context
0809 18:58:33.124513 (+ 295us) client_negotiation.cc:240] Negotiation successful
0809 18:58:33.125044 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15091,"thread_start_us":14885,"threads_started":1}
I20260809 18:58:33.128329 2932 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45159
I20260809 18:58:33.128839 2932 heartbeater.cc:464] Registering TS with master...
I20260809 18:58:33.130203 2932 heartbeater.cc:511] Master 127.16.188.254:45159 requested a full tablet report, sending...
I20260809 18:58:33.132535 2365 ts_manager.cc:194] Registered new tserver with Master: 48a28e3b651f4e6982c5761575701de1 (127.16.188.194:45765)
I20260809 18:58:33.133850 2365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:42335
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
I20260809 18:58:33.152146 2694 heartbeater.cc:503] Master 127.16.188.254:45159 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:58:33.168593 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:50993/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45159
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:43375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:58:33.718534 2943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:58:33.718888 2943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:58:33.719074 2943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:58:33.728659 2943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:58:33.728773 2943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:58:33.728929 2943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:58:33.739647 2943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:43375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.16.188.212:50993/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:45159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:58:33.740947 2943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:58:33.742218 2943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:58:33.756148 2953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:33.757397 2959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:58:33.757411 2954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:58:33.758162 2943 server_base.cc:1034] running on GCE node
I20260809 18:58:33.758726 2943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:58:33.759629 2943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:58:33.760833 2943 hybrid_clock.cc:648] HybridClock initialized: now 1786301913760789 us; error 34 us; skew 500 ppm
I20260809 18:58:33.761250 2943 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:58:33 dist-test-slave-266d krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301913, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:58:33.764662 2943 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:58:33.766165 2943 webserver.cc:460] Webserver started at http://127.16.188.195:46333/ using document root <none> and password file <none>
I20260809 18:58:33.766801 2943 fs_manager.cc:359] Metadata directory not provided
I20260809 18:58:33.766912 2943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:58:33.767190 2943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:58:33 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301913, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:58:33.784698 2943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "850e4fa32ab6416ead278be7a8144b26"
format_stamp: "Formatted at 2026-08-09 18:58:33 on dist-test-slave-266d"
server_key: "67cbece7d70d572cd139cc95436ed401"
server_key_iv: "1ce5456789b8a82049549528a5578c52"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:33.785902 2943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "850e4fa32ab6416ead278be7a8144b26"
format_stamp: "Formatted at 2026-08-09 18:58:33 on dist-test-slave-266d"
server_key: "67cbece7d70d572cd139cc95436ed401"
server_key_iv: "1ce5456789b8a82049549528a5578c52"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:33.792583 2943 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 18:58:33.810514 2971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:33.812517 2943 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260809 18:58:33.812786 2943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "850e4fa32ab6416ead278be7a8144b26"
format_stamp: "Formatted at 2026-08-09 18:58:33 on dist-test-slave-266d"
server_key: "67cbece7d70d572cd139cc95436ed401"
server_key_iv: "1ce5456789b8a82049549528a5578c52"
server_key_version: "kuduclusterkey@0"
I20260809 18:58:33.813145 2943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:58:33.833591 2943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:58:33.838198 2943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:58:33.838734 2943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:58:33.840466 2943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:58:33.842990 2943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:58:33.843101 2943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:33.843310 2943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:58:33.843434 2943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:58:33.906045 2943 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:35055
I20260809 18:58:33.906080 3164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:35055 every 8 connection(s)
I20260809 18:58:33.907477 2943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:58:33.910344 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 2943
I20260809 18:58:33.910528 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:58:33.911289 17139 external_mini_cluster.cc:1428] Setting key 4de1c6cdfd277d06fb13e6bf6944fe2b
Aug 09 18:58:33 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301913, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:58:33.930460 3168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.910484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:51643 (local address 127.16.188.254:45159)
0809 18:58:33.911375 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:33.911383 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:33.912479 (+ 1096us) server_negotiation.cc:407] Connection header received
0809 18:58:33.915337 (+ 2858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:33.915343 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:33.915431 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:33.915536 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:33.917314 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.918334 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.920039 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.920667 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.920771 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.924557 (+ 3786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:33.924562 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:33.924565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:33.924612 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:33.927651 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:33.928282 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:33.928286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:33.928288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:33.928400 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:33.928743 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:33.928745 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:33.928747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:33.929169 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:33.929316 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:33.929894 (+ 578us) server_negotiation.cc:299] Negotiation successful
0809 18:58:33.930076 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":489,"threads_started":1}
I20260809 18:58:33.931105 3169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.911160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:45159 (local address 127.16.188.195:51643)
0809 18:58:33.912315 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:33.912359 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:33.915048 (+ 2689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:33.915802 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:33.915810 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:33.916262 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:58:33.917127 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.917157 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.918466 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.918470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.919871 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.919885 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.920881 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.920886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.921300 (+ 414us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.922069 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:58:33.922095 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:58:33.924350 (+ 2255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:58:33.927775 (+ 3425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:33.927781 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:33.927792 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:33.928190 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:33.928471 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:58:33.928474 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:58:33.928476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:58:33.928659 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:58:33.929279 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:58:33.929285 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:58:33.929557 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 18:58:33.929764 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 18:58:33.930100 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"thread_start_us":605,"threads_started":1}
I20260809 18:58:33.932415 3165 heartbeater.cc:347] Connected to a master server at 127.16.188.254:45159
I20260809 18:58:33.932698 3165 heartbeater.cc:464] Registering TS with master...
I20260809 18:58:33.933633 3165 heartbeater.cc:511] Master 127.16.188.254:45159 requested a full tablet report, sending...
I20260809 18:58:33.935060 2365 ts_manager.cc:194] Registered new tserver with Master: 850e4fa32ab6416ead278be7a8144b26 (127.16.188.195:35055)
I20260809 18:58:33.935993 2365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:51643
I20260809 18:58:33.939247 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:58:33.959419 3168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.944575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53310 (local address 127.16.188.254:45159)
0809 18:58:33.944770 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:33.944775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:33.944970 (+ 195us) server_negotiation.cc:407] Connection header received
0809 18:58:33.945187 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:33.945190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:33.945294 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:33.945371 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:33.947418 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.948334 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.950072 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.950834 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.950945 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.953740 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:33.953746 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:33.953749 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:33.953786 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:33.956834 (+ 3048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:33.957496 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:33.957500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:33.957502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:33.957654 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:33.958012 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:33.958015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:33.958018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:33.958376 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:33.958597 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:33.958915 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 18:58:33.959129 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 18:58:33.963446 2365 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:58:33.972499 2365 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:58:33.998220 3200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.985964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60384 (local address 127.16.188.194:45765)
0809 18:58:33.986470 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:33.986478 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:33.987483 (+ 1005us) server_negotiation.cc:407] Connection header received
0809 18:58:33.987594 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:33.987601 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:33.987901 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:33.988123 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:33.990052 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.991824 (+ 1772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.995109 (+ 3285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.996852 (+ 1743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.997071 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.997295 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:33.997719 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 18:58:33.997895 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":271,"threads_started":1}
I20260809 18:58:33.998315 3196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.985751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:45765 (local address 127.0.0.1:60384)
0809 18:58:33.987043 (+ 1292us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:33.987083 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:33.987280 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:33.988186 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:33.988193 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:33.988233 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:33.989867 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.989878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.991978 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.991982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.994943 (+ 2961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.994959 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.997179 (+ 2220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.997188 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.997449 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.997509 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 18:58:33.997644 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 18:58:33.997857 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"thread_start_us":912,"threads_started":1}
I20260809 18:58:33.999468 3201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.985872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:35055 (local address 127.0.0.1:39176)
0809 18:58:33.988554 (+ 2682us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:33.988572 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:33.988741 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:33.990289 (+ 1548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:33.990295 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:33.990320 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:33.991145 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.991161 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.993009 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.993014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.995830 (+ 2816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.995846 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.997539 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.997546 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.997796 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.997831 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:58:33.997924 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 18:58:33.998806 (+ 882us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2299,"mutex_wait_us":3,"thread_start_us":2085,"threads_started":1}
I20260809 18:58:33.999890 3204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.988384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:43065 (local address 127.0.0.1:49152)
0809 18:58:33.989568 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:33.989592 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:33.989700 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:33.991226 (+ 1526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:33.991230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:33.991255 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:33.991982 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.991998 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.994377 (+ 2379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.994383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.996381 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:33.996396 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.998951 (+ 2555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.998957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:33.999131 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.999170 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 18:58:33.999267 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 18:58:33.999391 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1070,"thread_start_us":896,"threads_started":1}
I20260809 18:58:34.000054 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.986581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39176 (local address 127.16.188.195:35055)
0809 18:58:33.987770 (+ 1189us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:33.987777 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:33.988777 (+ 1000us) server_negotiation.cc:407] Connection header received
0809 18:58:33.989150 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:33.989159 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:33.989423 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:33.989643 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:33.991368 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.992879 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.995995 (+ 3116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.997265 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.997449 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.997610 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:33.999540 (+ 1930us) server_negotiation.cc:299] Negotiation successful
0809 18:58:33.999703 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":984,"thread_start_us":712,"threads_started":1}
I20260809 18:58:34.000483 3206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:33.988687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49152 (local address 127.16.188.193:43065)
0809 18:58:33.990228 (+ 1541us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:33.990236 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:33.990262 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:58:33.990395 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:33.990402 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:33.990645 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:33.990842 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:33.992272 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.994185 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.996582 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:33.998428 (+ 1846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:33.998630 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:33.998796 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:33.999784 (+ 988us) server_negotiation.cc:299] Negotiation successful
0809 18:58:33.999970 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1376,"thread_start_us":1197,"threads_started":1}
I20260809 18:58:34.002197 2823 tablet_service.cc:1467] Processing CreateTablet for tablet 532ff4fa768c49e4a3f370163cefca35 (DEFAULT_TABLE table=test-table [id=74a1e7dacd6c4360b217055c84f1522f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:58:34.003890 2823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532ff4fa768c49e4a3f370163cefca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:58:34.003780 3063 tablet_service.cc:1467] Processing CreateTablet for tablet 532ff4fa768c49e4a3f370163cefca35 (DEFAULT_TABLE table=test-table [id=74a1e7dacd6c4360b217055c84f1522f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:58:34.003832 2599 tablet_service.cc:1467] Processing CreateTablet for tablet 532ff4fa768c49e4a3f370163cefca35 (DEFAULT_TABLE table=test-table [id=74a1e7dacd6c4360b217055c84f1522f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:58:34.005682 2599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532ff4fa768c49e4a3f370163cefca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:58:34.005791 3063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532ff4fa768c49e4a3f370163cefca35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:58:34.018770 3208 tablet_bootstrap.cc:492] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Bootstrap starting.
I20260809 18:58:34.022182 3209 tablet_bootstrap.cc:492] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Bootstrap starting.
I20260809 18:58:34.023691 3208 tablet_bootstrap.cc:654] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Neither blocks nor log segments found. Creating new log.
I20260809 18:58:34.023825 3212 tablet_bootstrap.cc:492] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Bootstrap starting.
I20260809 18:58:34.025839 3208 log.cc:824] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Log is configured to *not* fsync() on all Append() calls
I20260809 18:58:34.026566 3209 tablet_bootstrap.cc:654] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Neither blocks nor log segments found. Creating new log.
I20260809 18:58:34.028199 3209 log.cc:824] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Log is configured to *not* fsync() on all Append() calls
I20260809 18:58:34.028470 3212 tablet_bootstrap.cc:654] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Neither blocks nor log segments found. Creating new log.
I20260809 18:58:34.030019 3212 log.cc:824] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Log is configured to *not* fsync() on all Append() calls
I20260809 18:58:34.030221 3208 tablet_bootstrap.cc:492] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: No bootstrap required, opened a new log
I20260809 18:58:34.030495 3208 ts_tablet_manager.cc:1397] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.008s
I20260809 18:58:34.031821 3209 tablet_bootstrap.cc:492] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: No bootstrap required, opened a new log
I20260809 18:58:34.032167 3209 ts_tablet_manager.cc:1397] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260809 18:58:34.033432 3212 tablet_bootstrap.cc:492] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: No bootstrap required, opened a new log
I20260809 18:58:34.033756 3212 ts_tablet_manager.cc:1397] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260809 18:58:34.044601 3212 raft_consensus.cc:348] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.045070 3212 raft_consensus.cc:374] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:58:34.045257 3212 raft_consensus.cc:729] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850e4fa32ab6416ead278be7a8144b26, State: Initialized, Role: FOLLOWER
I20260809 18:58:34.045079 3208 raft_consensus.cc:348] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.045712 3208 raft_consensus.cc:374] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:58:34.045889 3208 raft_consensus.cc:729] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a28e3b651f4e6982c5761575701de1, State: Initialized, Role: FOLLOWER
I20260809 18:58:34.045977 3212 consensus_queue.cc:260] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.046604 3208 consensus_queue.cc:260] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.046556 3209 raft_consensus.cc:348] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.047206 3209 raft_consensus.cc:374] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:58:34.047400 3209 raft_consensus.cc:729] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda568ec860043eca2c93065738f7298, State: Initialized, Role: FOLLOWER
I20260809 18:58:34.047730 3165 heartbeater.cc:503] Master 127.16.188.254:45159 was elected leader, sending a full tablet report...
I20260809 18:58:34.048298 3212 ts_tablet_manager.cc:1428] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260809 18:58:34.048224 3209 consensus_queue.cc:260] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.051429 3209 ts_tablet_manager.cc:1428] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Time spent starting tablet: real 0.019s user 0.012s sys 0.007s
I20260809 18:58:34.052789 2932 heartbeater.cc:503] Master 127.16.188.254:45159 was elected leader, sending a full tablet report...
I20260809 18:58:34.053500 3208 ts_tablet_manager.cc:1428] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Time spent starting tablet: real 0.023s user 0.012s sys 0.012s
W20260809 18:58:34.095639 2935 tablet.cc:2369] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:58:34.097391 2695 tablet.cc:2369] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:58:34.101894 3222 raft_consensus.cc:482] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:58:34.102284 3222 raft_consensus.cc:504] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.104269 3222 leader_election.cc:288] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a28e3b651f4e6982c5761575701de1 (127.16.188.194:45765), 850e4fa32ab6416ead278be7a8144b26 (127.16.188.195:35055)
I20260809 18:58:34.114209 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:34.104718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:40993 (local address 127.16.188.195:35055)
0809 18:58:34.105008 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:34.105015 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:34.106073 (+ 1058us) server_negotiation.cc:407] Connection header received
0809 18:58:34.106318 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:34.106322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:34.106385 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:34.106463 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:34.107265 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.108224 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.111336 (+ 3112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.112955 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.113157 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:34.113244 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:34.113734 (+ 490us) server_negotiation.cc:299] Negotiation successful
0809 18:58:34.113874 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 18:58:34.114513 3224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:34.104499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:35055 (local address 127.16.188.193:40993)
0809 18:58:34.105934 (+ 1435us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:34.105950 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:34.106143 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:34.106506 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:34.106514 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:34.106545 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:34.107111 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:34.107122 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.108382 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.108386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:34.111137 (+ 2751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:34.111158 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.113304 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.113310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:34.113491 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:34.113518 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 18:58:34.113623 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 18:58:34.113771 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1279,"mutex_wait_us":21,"spinlock_wait_cycles":79232,"thread_start_us":948,"threads_started":1}
I20260809 18:58:34.115358 3200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:34.104743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:32965 (local address 127.16.188.194:45765)
0809 18:58:34.105011 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:34.105017 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:34.106769 (+ 1752us) server_negotiation.cc:407] Connection header received
0809 18:58:34.107007 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:34.107011 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:34.107068 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:34.107145 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:58:34.108229 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.109257 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.112340 (+ 3083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.114009 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.114206 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:34.114277 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:34.114888 (+ 611us) server_negotiation.cc:299] Negotiation successful
0809 18:58:34.115017 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:58:34.115569 3226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:34.105169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:45765 (local address 127.16.188.193:32965)
0809 18:58:34.106670 (+ 1501us) negotiation.cc:107] Waiting for socket to connect
0809 18:58:34.106685 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:58:34.106869 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:58:34.107176 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:58:34.107180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:58:34.107203 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:58:34.108044 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:34.108056 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.109404 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.109410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:34.112164 (+ 2754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:58:34.112177 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.114500 (+ 2323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.114511 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:58:34.114735 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:34.114760 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 18:58:34.114842 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 18:58:34.114962 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1340,"mutex_wait_us":6,"thread_start_us":981,"threads_started":1}
I20260809 18:58:34.116154 3090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "532ff4fa768c49e4a3f370163cefca35" candidate_uuid: "dda568ec860043eca2c93065738f7298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850e4fa32ab6416ead278be7a8144b26" is_pre_election: true
I20260809 18:58:34.116725 2851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "532ff4fa768c49e4a3f370163cefca35" candidate_uuid: "dda568ec860043eca2c93065738f7298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a28e3b651f4e6982c5761575701de1" is_pre_election: true
I20260809 18:58:34.116918 3090 raft_consensus.cc:2454] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda568ec860043eca2c93065738f7298 in term 0.
I20260809 18:58:34.117453 2851 raft_consensus.cc:2454] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda568ec860043eca2c93065738f7298 in term 0.
I20260809 18:58:34.117805 2516 leader_election.cc:302] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 850e4fa32ab6416ead278be7a8144b26, dda568ec860043eca2c93065738f7298; no voters:
I20260809 18:58:34.118396 3222 raft_consensus.cc:2781] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:58:34.118657 3222 raft_consensus.cc:482] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:58:34.118839 3222 raft_consensus.cc:3037] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:58:34.122129 3222 raft_consensus.cc:504] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.122972 3222 leader_election.cc:288] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [CANDIDATE]: Term 1 election: Requested vote from peers 48a28e3b651f4e6982c5761575701de1 (127.16.188.194:45765), 850e4fa32ab6416ead278be7a8144b26 (127.16.188.195:35055)
I20260809 18:58:34.123407 2851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "532ff4fa768c49e4a3f370163cefca35" candidate_uuid: "dda568ec860043eca2c93065738f7298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a28e3b651f4e6982c5761575701de1"
I20260809 18:58:34.123646 2851 raft_consensus.cc:3037] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:58:34.123636 3090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "532ff4fa768c49e4a3f370163cefca35" candidate_uuid: "dda568ec860043eca2c93065738f7298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850e4fa32ab6416ead278be7a8144b26"
I20260809 18:58:34.123859 3090 raft_consensus.cc:3037] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:58:34.126688 2851 raft_consensus.cc:2454] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda568ec860043eca2c93065738f7298 in term 1.
I20260809 18:58:34.127108 3090 raft_consensus.cc:2454] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda568ec860043eca2c93065738f7298 in term 1.
I20260809 18:58:34.127174 2515 leader_election.cc:302] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a28e3b651f4e6982c5761575701de1, dda568ec860043eca2c93065738f7298; no voters:
I20260809 18:58:34.127589 3222 raft_consensus.cc:2781] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:58:34.128360 3222 raft_consensus.cc:686] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 1 LEADER]: Becoming Leader. State: Replica: dda568ec860043eca2c93065738f7298, State: Running, Role: LEADER
I20260809 18:58:34.128916 3222 consensus_queue.cc:237] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } }
I20260809 18:58:34.134850 2363 catalog_manager.cc:5495] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 reported cstate change: term changed from 0 to 1, leader changed from <none> to dda568ec860043eca2c93065738f7298 (127.16.188.193). New cstate: current_term: 1 leader_uuid: "dda568ec860043eca2c93065738f7298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dda568ec860043eca2c93065738f7298" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43065 } health_report { overall_health: HEALTHY } } }
I20260809 18:58:34.155082 3206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:34.147335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49166 (local address 127.16.188.193:43065)
0809 18:58:34.147674 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:34.147681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:34.147702 (+ 21us) server_negotiation.cc:407] Connection header received
0809 18:58:34.147801 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:34.147805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:34.147886 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:34.148030 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:58:34.148625 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.149682 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.152347 (+ 2665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.152949 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.153124 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:34.153846 (+ 722us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:58:34.154412 (+ 566us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:58:34.154569 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:34.154674 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 18:58:34.154761 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 18:58:34.159552 3166 tablet.cc:2369] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:58:34.165243 3090 raft_consensus.cc:1261] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 1 FOLLOWER]: Refusing update from remote peer dda568ec860043eca2c93065738f7298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:58:34.165235 2851 raft_consensus.cc:1261] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 1 FOLLOWER]: Refusing update from remote peer dda568ec860043eca2c93065738f7298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:58:34.166396 3222 consensus_queue.cc:1035] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850e4fa32ab6416ead278be7a8144b26" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:58:34.166818 3227 consensus_queue.cc:1035] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a28e3b651f4e6982c5761575701de1" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:58:34.180509 3232 mvcc.cc:205] Tried to move back new op lower bound from 7316692640409276416 to 7316692640276271104. Current Snapshot: MvccSnapshot[applied={T|T < 7316692640409276416}]
I20260809 18:58:34.199952 2364 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:58:34.200526 2364 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:58:34.205845 2364 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 825ba56e4c754a63bbc23807b119dfeb: Sending DeleteTablet for 3 replicas of tablet 532ff4fa768c49e4a3f370163cefca35
I20260809 18:58:34.207422 2823 tablet_service.cc:1514] Processing DeleteTablet for tablet 532ff4fa768c49e4a3f370163cefca35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:58:34 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:60384
I20260809 18:58:34.207448 3063 tablet_service.cc:1514] Processing DeleteTablet for tablet 532ff4fa768c49e4a3f370163cefca35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:58:34 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:39176
I20260809 18:58:34.208887 2599 tablet_service.cc:1514] Processing DeleteTablet for tablet 532ff4fa768c49e4a3f370163cefca35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:58:34 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:49152
I20260809 18:58:34.211627 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 2481
I20260809 18:58:34.218305 3249 tablet_replica.cc:330] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: stopping tablet replica
I20260809 18:58:34.218863 3249 raft_consensus.cc:2229] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:58:34.219837 3249 raft_consensus.cc:2258] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:58:34.222693 3249 ts_tablet_manager.cc:1905] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:58:34.223721 3247 tablet_replica.cc:330] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: stopping tablet replica
I20260809 18:58:34.224138 3247 raft_consensus.cc:2229] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:58:34.224653 3247 raft_consensus.cc:2258] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:58:34.231057 3249 ts_tablet_manager.cc:1918] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:58:34.231318 3249 log.cc:1196] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/532ff4fa768c49e4a3f370163cefca35
I20260809 18:58:34.232162 3247 ts_tablet_manager.cc:1905] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:58:34.233379 3249 ts_tablet_manager.cc:1939] T 532ff4fa768c49e4a3f370163cefca35 P dda568ec860043eca2c93065738f7298: Deleting consensus metadata
I20260809 18:58:34.232832 3246 tablet_replica.cc:330] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: stopping tablet replica
I20260809 18:58:34.233970 3246 raft_consensus.cc:2229] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 1 FOLLOWER]: Raft consensus shutting down.
Aug 09 18:58:34 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:58:34.236148 3246 raft_consensus.cc:2258] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:58:34.236608 2347 catalog_manager.cc:4841] TS dda568ec860043eca2c93065738f7298 (127.16.188.193:43065): tablet 532ff4fa768c49e4a3f370163cefca35 (table test-table [id=74a1e7dacd6c4360b217055c84f1522f]) successfully deleted
I20260809 18:58:34.238529 3246 ts_tablet_manager.cc:1905] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:58:34.240934 3247 ts_tablet_manager.cc:1918] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:58:34.241129 3247 log.cc:1196] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/532ff4fa768c49e4a3f370163cefca35
I20260809 18:58:34.241668 3247 ts_tablet_manager.cc:1939] T 532ff4fa768c49e4a3f370163cefca35 P 850e4fa32ab6416ead278be7a8144b26: Deleting consensus metadata
I20260809 18:58:34.243491 2347 catalog_manager.cc:4841] TS 850e4fa32ab6416ead278be7a8144b26 (127.16.188.195:35055): tablet 532ff4fa768c49e4a3f370163cefca35 (table test-table [id=74a1e7dacd6c4360b217055c84f1522f]) successfully deleted
I20260809 18:58:34.244380 3206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:34.214724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49178 (local address 127.16.188.193:43065)
0809 18:58:34.214939 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:34.214947 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:34.217893 (+ 2946us) server_negotiation.cc:407] Connection header received
0809 18:58:34.218991 (+ 1098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:34.218997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:34.219102 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:34.219187 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:34.225122 (+ 5935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.226367 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.229198 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.229855 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.229961 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:34.235421 (+ 5460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:34.235435 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:34.235451 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:34.235505 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:34.240190 (+ 4685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:34.241198 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:34.241235 (+ 37us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:34.241241 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:34.241420 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:34.241931 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:34.241936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:34.241940 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:34.242396 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:34.242702 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:34.243939 (+ 1237us) server_negotiation.cc:299] Negotiation successful
0809 18:58:34.244130 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 18:58:34.245131 2687 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:58:34.245980 3246 ts_tablet_manager.cc:1918] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:58:34.246163 3246 log.cc:1196] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/532ff4fa768c49e4a3f370163cefca35
I20260809 18:58:34.246683 3246 ts_tablet_manager.cc:1939] T 532ff4fa768c49e4a3f370163cefca35 P 48a28e3b651f4e6982c5761575701de1: Deleting consensus metadata
I20260809 18:58:34.248519 2346 catalog_manager.cc:4841] TS 48a28e3b651f4e6982c5761575701de1 (127.16.188.194:45765): tablet 532ff4fa768c49e4a3f370163cefca35 (table test-table [id=74a1e7dacd6c4360b217055c84f1522f]) successfully deleted
I20260809 18:58:34.342810 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 2481
I20260809 18:58:34.368077 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 2704
Aug 09 18:58:34 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:58:34.382615 3200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:34.368816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60394 (local address 127.16.188.194:45765)
0809 18:58:34.369002 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:34.369006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:34.369026 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:58:34.369220 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:34.369224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:34.369306 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:34.369386 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:34.370698 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.371403 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.372774 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.373192 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.373287 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:34.377354 (+ 4067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:34.377376 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:34.377403 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:34.377442 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:34.380173 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:34.380803 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:34.380809 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:34.380811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:34.380934 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:34.381296 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:34.381300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:34.381302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:34.381640 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:34.381864 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:34.382085 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 18:58:34.382276 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 18:58:34.383255 2921 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:58:34.471242 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 2704
I20260809 18:58:34.490803 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 2943
Aug 09 18:58:34 dist-test-slave-266d krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:58:34.505074 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:58:34.491618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39180 (local address 127.16.188.195:35055)
0809 18:58:34.491807 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:58:34.491812 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:58:34.491831 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:58:34.491973 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:58:34.491977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:58:34.492038 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:58:34.492117 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:58:34.493423 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.494157 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.495382 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:58:34.495753 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:58:34.495847 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:58:34.500177 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:58:34.500193 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:58:34.500210 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:58:34.500244 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:58:34.502794 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:34.503415 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:34.503421 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:34.503424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:34.503542 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:58:34.503810 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:58:34.503813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:58:34.503815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:58:34.504178 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:58:34.504399 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 18:58:34.504585 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 18:58:34.504746 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 18:58:34.505764 3159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:58:34.593838 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 2943
I20260809 18:58:34.617933 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 2313
I20260809 18:58:34.619108 2406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:58:34.731990 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 2313
I20260809 18:58:34.765865 17139 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 18:58:35.112269 17139 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 18:58:35.112525 17139 mini_ranger.cc:66] Stopping Ranger...
I20260809 18:58:35.457064 17139 mini_ranger.cc:68] Stopped Ranger
2026-08-09 18:58:35.457 UTC [1604] LOG: received smart shutdown request
2026-08-09 18:58:35.461 UTC [1604] LOG: background worker "logical replication launcher" (PID 1622) exited with exit code 1
2026-08-09 18:58:35.461 UTC [1609] LOG: shutting down
2026-08-09 18:58:35.595 UTC [1604] LOG: database system is shut down
2026-08-09T18:58:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50409 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:58:35 dist-test-slave-266d krb5kdc[3275](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:58:35 dist-test-slave-266d krb5kdc[3275](info): set up 2 sockets
Aug 09 18:58:35 dist-test-slave-266d krb5kdc[3275](info): commencing operation
krb5kdc: starting...
W20260809 18:58:36.921921 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.005s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:58:37 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:58:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:58:37Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.16.188.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.16.188.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/rangeradmin_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/rangeradmin_127.16.188.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.16.188.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.16.188.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/rangerlookup_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/rangerlookup_127.16.188.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.188.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.16.188.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/HTTP_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/HTTP_127.16.188.212@KRBTEST.COM.keytab.
I20260809 18:58:37.261230 17139 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskr97ygv/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/postgres -l logfile start
2026-08-09 18:58:39.520 UTC [3319] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 18:58:39.520 UTC [3319] LOG: listening on IPv4 address "127.16.188.212", port 54577
2026-08-09 18:58:39.524 UTC [3319] LOG: listening on Unix socket "/tmp/.s.PGSQL.54577"
2026-08-09 18:58:39.547 UTC [3324] LOG: database system was shut down at 2026-08-09 18:58:38 UTC
2026-08-09 18:58:39.550 UTC [3319] LOG: database system is ready to accept connections
I20260809 18:58:40.659552 17139 mini_postgres.cc:96] Postgres bound to 54577
2026-08-09 18:58:40.680 UTC [3336] FATAL: database "slave" does not exist
127.16.188.212:54577 - accepting connections
I20260809 18:58:40.681290 17139 mini_ranger.cc:161] Starting Ranger...
I20260809 18:58:40.707163 17139 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 18:58:41.132558 17139 mini_ranger.cc:87] Created ranger Postgres database
I20260809 18:58:41.132710 17139 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-admin
2026-08-09 18:58:41,417 [I] DB FLAVOR :POSTGRES
2026-08-09 18:58:41,417 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:58:41,417 [I] Checking connection..
2026-08-09 18:58:41,418 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 18:58:41,665 [I] Checking connection passed.
2026-08-09 18:58:41,666 [I] --------- Verifying version history table ---------
2026-08-09 18:58:41,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:58:41,915 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:58:41,916 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:58:42,171 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:58:42,171 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 18:58:42,171 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 18:58:42.438 UTC [3439] WARNING: there is no transaction in progress
2026-08-09 18:58:42,447 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 18:58:42,447 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:58:42,696 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 18:58:42,696 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:58:42,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 18:58:42,936 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 18:58:43,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-266d.c.gcp-upstream.internal','N') ;"
2026-08-09 18:58:43,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:58:43,694 [I] Table x_portal_user does not exist in database ranger
2026-08-09 18:58:43,694 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:58:43,948 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 18:58:43,948 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:58:44,199 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:58:44,449 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 18:58:44,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 18:58:45.329 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.344 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.359 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.372 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.386 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.404 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.453 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.458 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.471 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.480 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.489 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.501 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.510 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.516 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.521 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:45.527 UTC [3615] WARNING: there is no transaction in progress
2026-08-09 18:58:46,063 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 18:58:46,063 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 18:58:46,300 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 18:58:46,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:58:46,542 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 18:58:46,543 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:58:46,799 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 18:58:46,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:58:47,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:58:47,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-266d.c.gcp-upstream.internal';"
2026-08-09 18:58:47,537 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 18:58:47,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 18:58:47,793 [I] DB_PATCHES have already been applied
I20260809 18:58:47.798873 17139 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-admin:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskr97ygv/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 18:58:47.798966 17139 mini_ranger.cc:193] Using host: 127.16.188.212
I20260809 18:58:47.817209 17139 mini_ranger.cc:227] Ranger admin URL: http://127.16.188.212:42613
Aug 09, 2026 6:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 18:58:49.093300 17139 mini_ranger.cc:160] Time spent starting Ranger: real 8.412s user 0.002s sys 0.048s
Aug 09, 2026 6:59:08 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:59:08 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 6:59:08 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:59:08 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:59:09 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 18:59:10.179558 17139 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.16.188.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.16.188.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/rangerkms_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.16.188.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/rangerkms_127.16.188.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.188.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.16.188.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.188.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/HTTP_127.16.188.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.188.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/HTTP_127.16.188.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 18:59:10 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 18:59:10.369310 17139 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 18:59:10.394986 17139 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 18:59:11.115676 17139 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 18:59:11.115773 17139 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms
I20260809 18:59:11.115813 17139 mini_ranger_kms.cc:227] Using postgres at 127.16.188.212:54577
2026-08-09 18:59:11,459 [I] DB FLAVOR :POSTGRES
2026-08-09 18:59:11,459 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:59:11,459 [I] Checking connection
2026-08-09 18:59:11,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 18:59:11,727 [I] connection success
2026-08-09 18:59:11,727 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 18:59:11,727 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 18:59:11,727 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 18:59:11,955 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 18:59:11,956 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:59:11,956 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 18:59:11,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.188.212:54577/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 18:59:12,210 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 18:59:12.671697 17139 mini_ranger_kms.cc:310] Created kms service
I20260809 18:59:12.839097 17139 mini_ranger_kms.cc:326] Created kudu user
I20260809 18:59:12.880259 17139 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 18:59:12 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301950, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:13.272428 17139 mini_ranger_kms.cc:384] Added ranger policy
I20260809 18:59:13.272751 17139 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms:/tmp/dist-test-taskr97ygv/build/asan/bin/postgresql.jar:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskr97ygv/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 18:59:13.272816 17139 mini_ranger_kms.cc:240] Using host: 127.16.188.212
I20260809 18:59:13.291712 17139 mini_ranger_kms.cc:276] Ranger KMS PID: 3922
I20260809 18:59:13.291834 17139 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.16.188.212:53625
Aug 09, 2026 6:59:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:59:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:59:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:59:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:59:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:59:14 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 18:59:15 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.188.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:15.852954 17139 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.484s user 0.048s sys 0.322s
I20260809 18:59:15.853264 17139 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 18:59:15.853437 17139 mini_ranger_kms.cc:401] 127.16.188.212:53625/kms/v1/keys
Aug 09 18:59:15 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.188.212@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
Aug 09 18:59:16 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301955, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.188.212@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
Aug 09 18:59:18 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:59:18.474011 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:36709
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:36709
--ranger_config_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:53625/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:18.794879 4021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:18.795161 4021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:18.795285 4021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:18.802282 4021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:18.802397 4021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:18.802467 4021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:18.802541 4021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:18.802610 4021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:18.812440 4021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
--ranger_kms_url=127.16.188.212:53625/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:36709
--ranger_config_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:36709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:18.813774 4021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:18.815080 4021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:18.826131 4027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:18.826217 4033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:18.826225 4030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:18.827400 4021 server_base.cc:1034] running on GCE node
I20260809 18:59:18.828181 4021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:18.829632 4021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:18.830848 4021 hybrid_clock.cc:648] HybridClock initialized: now 1786301958830792 us; error 51 us; skew 500 ppm
I20260809 18:59:18.831202 4021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:18 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301958, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:18.837306 4021 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:59:18.838922 4021 webserver.cc:460] Webserver started at http://127.16.188.254:45849/ using document root <none> and password file <none>
I20260809 18:59:18.839607 4021 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:18.839732 4021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:18.840032 4021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:59:18 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301958, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:18.895539 4021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "06c366658bdf4ebf923ba28a5148be30"
format_stamp: "Formatted at 2026-08-09 18:59:18 on dist-test-slave-266d"
server_key: "afd52d4802ec909fc87ae1a77f1f6664"
server_key_iv: "2fe950b463683c58a54eb9be9a57fe21"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:18.896428 4021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "06c366658bdf4ebf923ba28a5148be30"
format_stamp: "Formatted at 2026-08-09 18:59:18 on dist-test-slave-266d"
server_key: "afd52d4802ec909fc87ae1a77f1f6664"
server_key_iv: "2fe950b463683c58a54eb9be9a57fe21"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:18.901999 4021 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 18:59:18.921270 4050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:18.923015 4021 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 18:59:18.923204 4021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "06c366658bdf4ebf923ba28a5148be30"
format_stamp: "Formatted at 2026-08-09 18:59:18 on dist-test-slave-266d"
server_key: "afd52d4802ec909fc87ae1a77f1f6664"
server_key_iv: "2fe950b463683c58a54eb9be9a57fe21"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:18.923465 4021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:18.943161 4021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:18.946496 4021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:18.946743 4021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:18.963446 4021 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:36709
I20260809 18:59:18.963469 4135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:36709 every 8 connection(s)
I20260809 18:59:18.964664 4021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:18.966485 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 4021
I20260809 18:59:18.966717 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:59:18.967562 17139 external_mini_cluster.cc:1428] Setting key 85ff076228c6bab5e250cb8d55354c4e
I20260809 18:59:18.968969 4136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 18:59:18 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:18.982129 4136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Bootstrap starting.
I20260809 18:59:18.985044 4136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:18.986097 4136 log.cc:824] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:18.988574 4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:18.969526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57498 (local address 127.16.188.254:36709)
0809 18:59:18.970240 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:18.970250 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:18.970289 (+ 39us) server_negotiation.cc:407] Connection header received
0809 18:59:18.971815 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:18.971835 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:18.972178 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:18.972487 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:18.974071 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:18.975357 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:18.977209 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:18.977835 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:18.977954 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:18.982218 (+ 4264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:18.982229 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:18.982246 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:18.982289 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:18.984934 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:18.985604 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:18.985611 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:18.985616 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:18.985774 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:18.986127 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:18.986131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:18.986133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:18.986647 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:18.986967 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:18.987358 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 18:59:18.987686 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":332,"threads_started":1}
I20260809 18:59:18.988710 4136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: No bootstrap required, opened a new log
I20260809 18:59:18.995749 4136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } }
I20260809 18:59:18.996057 4136 raft_consensus.cc:374] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:18.996146 4136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c366658bdf4ebf923ba28a5148be30, State: Initialized, Role: FOLLOWER
I20260809 18:59:18.996757 4136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } }
I20260809 18:59:18.997031 4136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:18.997213 4136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:18.997400 4136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:18.999311 4136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } }
I20260809 18:59:18.999724 4136 leader_election.cc:302] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06c366658bdf4ebf923ba28a5148be30; no voters:
I20260809 18:59:19.000193 4136 leader_election.cc:288] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:59:19.000300 4143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:19.000905 4143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 1 LEADER]: Becoming Leader. State: Replica: 06c366658bdf4ebf923ba28a5148be30, State: Running, Role: LEADER
I20260809 18:59:19.001387 4143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } }
I20260809 18:59:19.002106 4136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:19.003984 4151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06c366658bdf4ebf923ba28a5148be30. Latest consensus state: current_term: 1 leader_uuid: "06c366658bdf4ebf923ba28a5148be30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } } }
I20260809 18:59:19.004071 4144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06c366658bdf4ebf923ba28a5148be30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } } }
I20260809 18:59:19.004356 4151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:19.004396 4144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:19.009950 4157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:19.010432 4136 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 18:59:19.023129 4157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:19.033043 4157 catalog_manager.cc:1347] Generated new cluster ID: 08819364c8c740fcba2986513d142f14
I20260809 18:59:19.033219 4157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:19.044122 4157 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:19.045598 4157 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:19.053589 4157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Generated new TSK 0
I20260809 18:59:19.054312 4157 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:59:19.784801 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:53625/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36709
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:59:20 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301960, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 18:59:20.216751 4210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:20.217254 4210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:20.217470 4210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:20.229516 4210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:20.229684 4210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:20.229924 4210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:59:20.245977 4210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.16.188.212:53625/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:20.247776 4210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:20.249675 4210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:20.282039 4224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:20.288628 4223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:20.289352 4226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:20.291008 4210 server_base.cc:1034] running on GCE node
I20260809 18:59:20.291785 4210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:20.293004 4210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:20.294272 4210 hybrid_clock.cc:648] HybridClock initialized: now 1786301960294212 us; error 41 us; skew 500 ppm
I20260809 18:59:20.294636 4210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:20 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301960, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:20.298170 4210 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:59:20.299958 4210 webserver.cc:460] Webserver started at http://127.16.188.193:38371/ using document root <none> and password file <none>
I20260809 18:59:20.300895 4210 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:20.301030 4210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:20.301412 4210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:59:20 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301960, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:20.318856 4210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "5792b939e4e64449bd0a2619705273d7"
format_stamp: "Formatted at 2026-08-09 18:59:20 on dist-test-slave-266d"
server_key: "9639607ce334d73f931232de0c11b49d"
server_key_iv: "2a3cce28dad6eba6d635d106d0ea8268"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:20.319983 4210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "5792b939e4e64449bd0a2619705273d7"
format_stamp: "Formatted at 2026-08-09 18:59:20 on dist-test-slave-266d"
server_key: "9639607ce334d73f931232de0c11b49d"
server_key_iv: "2a3cce28dad6eba6d635d106d0ea8268"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:20.333683 4210 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.004s sys 0.008s
I20260809 18:59:20.362301 4239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:20.364218 4210 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.013s sys 0.000s
I20260809 18:59:20.364475 4210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "5792b939e4e64449bd0a2619705273d7"
format_stamp: "Formatted at 2026-08-09 18:59:20 on dist-test-slave-266d"
server_key: "9639607ce334d73f931232de0c11b49d"
server_key_iv: "2a3cce28dad6eba6d635d106d0ea8268"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:20.364782 4210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:20.395404 4210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:20.400607 4210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:20.400949 4210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:20.402174 4210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:20.405922 4210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:20.406072 4210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:20.406215 4210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:20.406275 4210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:59:20 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301960, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:20.505548 4210 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:36171
I20260809 18:59:20.505537 4420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:36171 every 8 connection(s)
I20260809 18:59:20.507431 4210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:20.509017 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 4210
I20260809 18:59:20.509339 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:59:20.510155 17139 external_mini_cluster.cc:1428] Setting key bc134a56c91efd15b93818f4263b9eb7
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Aug 09 18:59:20 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301960, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:20.571606 4425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:20.517939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36709 (local address 127.16.188.193:41591)
0809 18:59:20.530089 (+ 12150us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:20.530155 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:20.532530 (+ 2375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:20.539480 (+ 6950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:20.539494 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:20.540185 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:20.541118 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:20.541149 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:20.542705 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:20.542711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:20.544784 (+ 2073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:20.544806 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:20.558493 (+ 13687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:20.558500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:20.558857 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:20.559730 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:20.559781 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:20.562632 (+ 2851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:20.566721 (+ 4089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:20.566732 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:20.566750 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:20.567326 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:20.567761 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:20.567766 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:20.567770 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:20.568023 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:20.568730 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:20.568739 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:20.569194 (+ 455us) client_negotiation.cc:769] Sending connection context
0809 18:59:20.569488 (+ 294us) client_negotiation.cc:240] Negotiation successful
0809 18:59:20.570112 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11810,"thread_start_us":11563,"threads_started":1}
I20260809 18:59:20.572688 4424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:20.517219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:41591 (local address 127.16.188.254:36709)
0809 18:59:20.529475 (+ 12256us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:20.529482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:20.532912 (+ 3430us) server_negotiation.cc:407] Connection header received
0809 18:59:20.532985 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:20.532990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:20.533128 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:20.533242 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:20.541351 (+ 8109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:20.542478 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:20.557239 (+ 14761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:20.557957 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:20.558082 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:20.562946 (+ 4864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:20.562954 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:20.562959 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:20.563012 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:20.566550 (+ 3538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:20.567474 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:20.567480 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:20.567484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:20.567636 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:20.568157 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:20.568162 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:20.568166 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:20.568503 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:20.568652 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:20.572123 (+ 3471us) server_negotiation.cc:299] Negotiation successful
0809 18:59:20.572342 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12112,"thread_start_us":11985,"threads_started":1}
I20260809 18:59:20.575067 4421 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36709
I20260809 18:59:20.575397 4421 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:20.576211 4421 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
I20260809 18:59:20.578718 4086 ts_manager.cc:194] Registered new tserver with Master: 5792b939e4e64449bd0a2619705273d7 (127.16.188.193:36171)
I20260809 18:59:20.580680 4086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:41591
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:59:20.589676 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:53625/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36709
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:59:20 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301960, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
W20260809 18:59:21.073603 4430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:21.074112 4430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:21.074338 4430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:21.084348 4430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:21.084484 4430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:21.084666 4430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:59:21.094851 4430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.16.188.212:53625/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:21.096266 4430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:21.097770 4430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:21.113050 4451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:21.114562 4453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:21.122812 4430 server_base.cc:1034] running on GCE node
W20260809 18:59:21.125372 4455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:21.126217 4430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:21.132894 4430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:21.134164 4430 hybrid_clock.cc:648] HybridClock initialized: now 1786301961134056 us; error 106 us; skew 500 ppm
I20260809 18:59:21.134507 4430 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:21 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301961, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:21.137722 4430 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:59:21.142992 4430 webserver.cc:460] Webserver started at http://127.16.188.194:41981/ using document root <none> and password file <none>
I20260809 18:59:21.143774 4430 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:21.143893 4430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:21.144228 4430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:59:21 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301961, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:21.161351 4430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "0f94d111dd314b4496dcf0b16abcc23a"
format_stamp: "Formatted at 2026-08-09 18:59:21 on dist-test-slave-266d"
server_key: "d233d66232b939a38f98c0711ff936aa"
server_key_iv: "c78eb2dcf2b53353452a110ba8969b11"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:21.162488 4430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "0f94d111dd314b4496dcf0b16abcc23a"
format_stamp: "Formatted at 2026-08-09 18:59:21 on dist-test-slave-266d"
server_key: "d233d66232b939a38f98c0711ff936aa"
server_key_iv: "c78eb2dcf2b53353452a110ba8969b11"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:21.169956 4430 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260809 18:59:21.188262 4478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:21.189744 4430 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 18:59:21.189918 4430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "0f94d111dd314b4496dcf0b16abcc23a"
format_stamp: "Formatted at 2026-08-09 18:59:21 on dist-test-slave-266d"
server_key: "d233d66232b939a38f98c0711ff936aa"
server_key_iv: "c78eb2dcf2b53353452a110ba8969b11"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:21.190136 4430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:21.212136 4430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:21.216169 4430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:21.216524 4430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:21.218073 4430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:21.225955 4430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:21.226051 4430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:21.226169 4430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:21.226227 4430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:21.265345 4430 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:42681
I20260809 18:59:21.265348 4668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:42681 every 8 connection(s)
I20260809 18:59:21.266744 4430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:21.276226 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 4430
I20260809 18:59:21.276429 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:59:21.277035 17139 external_mini_cluster.cc:1428] Setting key f819fc4818931389a5b2ea5b35d31c80
Aug 09 18:59:21 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301961, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:21.291289 4671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.269566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:35087 (local address 127.16.188.254:36709)
0809 18:59:21.270124 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:21.270131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:21.271153 (+ 1022us) server_negotiation.cc:407] Connection header received
0809 18:59:21.272985 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:21.272992 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:21.273164 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:21.273320 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:21.274626 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.275788 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.278275 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.278987 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.279138 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:21.283690 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:21.283698 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:21.283703 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:21.283751 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:21.287489 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:21.288438 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:21.288444 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:21.288448 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:21.288618 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:21.289177 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:21.289183 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:21.289187 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:21.289593 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:21.289754 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:21.290807 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0809 18:59:21.291006 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":258,"threads_started":1}
I20260809 18:59:21.292754 4672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.270159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36709 (local address 127.16.188.194:35087)
0809 18:59:21.270977 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:21.271023 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:21.272708 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:21.273483 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:21.273490 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:21.273887 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:21.274446 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:21.274463 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.275972 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.275978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:21.277818 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:21.277831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.279458 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.279467 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:21.279804 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:21.280642 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:21.280684 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:21.283424 (+ 2740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:21.287683 (+ 4259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:21.287694 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:21.287714 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:21.288308 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:21.288746 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:21.288750 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:21.288753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:21.289028 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:21.289838 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:21.289848 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:21.290329 (+ 481us) client_negotiation.cc:769] Sending connection context
0809 18:59:21.290663 (+ 334us) client_negotiation.cc:240] Negotiation successful
0809 18:59:21.291238 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":338,"threads_started":1}
I20260809 18:59:21.294626 4669 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36709
I20260809 18:59:21.294979 4669 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:21.295887 4669 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
I20260809 18:59:21.297887 4086 ts_manager.cc:194] Registered new tserver with Master: 0f94d111dd314b4496dcf0b16abcc23a (127.16.188.194:42681)
I20260809 18:59:21.298985 4086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:35087
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:59:21.337329 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:53625/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36709
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:21.584962 4421 heartbeater.cc:503] Master 127.16.188.254:36709 was elected leader, sending a full tablet report...
W20260809 18:59:21.664505 4675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:21.664788 4675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:21.664919 4675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:21.672268 4675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:21.672384 4675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:21.672544 4675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:59:21.682730 4675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.16.188.212:53625/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:36709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:21.684062 4675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:21.685386 4675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:21.698127 4684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:21.698127 4687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:21.698167 4685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:21.698974 4675 server_base.cc:1034] running on GCE node
I20260809 18:59:21.699597 4675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:21.700452 4675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:21.701651 4675 hybrid_clock.cc:648] HybridClock initialized: now 1786301961701595 us; error 49 us; skew 500 ppm
I20260809 18:59:21.701939 4675 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:21 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301961, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:21.705201 4675 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:59:21.706643 4675 webserver.cc:460] Webserver started at http://127.16.188.195:37439/ using document root <none> and password file <none>
I20260809 18:59:21.707387 4675 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:21.707489 4675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:21.707733 4675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:59:21 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301961, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:21.725351 4675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "e02e01601785452aa88e9a3cc2917cf0"
format_stamp: "Formatted at 2026-08-09 18:59:21 on dist-test-slave-266d"
server_key: "680c4d992801850091c4bd7f1c91ab5a"
server_key_iv: "93b43322966f0b0162cb76532cb871e2"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:21.726313 4675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "e02e01601785452aa88e9a3cc2917cf0"
format_stamp: "Formatted at 2026-08-09 18:59:21 on dist-test-slave-266d"
server_key: "680c4d992801850091c4bd7f1c91ab5a"
server_key_iv: "93b43322966f0b0162cb76532cb871e2"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:21.733217 4675 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 18:59:21.750017 4703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:21.751950 4675 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 18:59:21.752162 4675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "e02e01601785452aa88e9a3cc2917cf0"
format_stamp: "Formatted at 2026-08-09 18:59:21 on dist-test-slave-266d"
server_key: "680c4d992801850091c4bd7f1c91ab5a"
server_key_iv: "93b43322966f0b0162cb76532cb871e2"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:21.752419 4675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:21.792393 4675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:21.796628 4675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:21.796895 4675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:21.797933 4675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:21.799288 4675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:21.799360 4675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:21.799479 4675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:21.799528 4675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:21.830152 4675 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:40175
I20260809 18:59:21.830201 4877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:40175 every 8 connection(s)
I20260809 18:59:21.831379 4675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:21.841614 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 4675
I20260809 18:59:21.841801 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:59:21.842425 17139 external_mini_cluster.cc:1428] Setting key 422667b3022baf2abbee975536bb8170
Aug 09 18:59:21 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301961, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:21.851553 4880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.833714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:37211 (local address 127.16.188.254:36709)
0809 18:59:21.834160 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:21.834165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:21.835039 (+ 874us) server_negotiation.cc:407] Connection header received
0809 18:59:21.836786 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:21.836792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:21.836883 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:21.836979 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:21.838628 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.839736 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.842108 (+ 2372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.842614 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.842738 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:21.846594 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:21.846599 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:21.846610 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:21.846645 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:21.849059 (+ 2414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:21.849750 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:21.849754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:21.849756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:21.849878 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:21.850226 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:21.850229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:21.850231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:21.850488 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:21.850595 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:21.851143 (+ 548us) server_negotiation.cc:299] Negotiation successful
0809 18:59:21.851303 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":209,"threads_started":1}
I20260809 18:59:21.852468 4881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.834196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36709 (local address 127.16.188.195:37211)
0809 18:59:21.834875 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:21.834918 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:21.836510 (+ 1592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:21.837249 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:21.837257 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:21.837658 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:21.838402 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:21.838428 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.839918 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.839924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:21.841921 (+ 1997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:21.841951 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.842887 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.842895 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:21.843177 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:21.843930 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:21.843959 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:21.846379 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:21.849205 (+ 2826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:21.849212 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:21.849224 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:21.849654 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:21.849956 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:21.849959 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:21.849961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:21.850147 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:21.850575 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:21.850580 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:21.850870 (+ 290us) client_negotiation.cc:769] Sending connection context
0809 18:59:21.851074 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 18:59:21.851443 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":261,"threads_started":1}
I20260809 18:59:21.853729 4878 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36709
I20260809 18:59:21.854020 4878 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:21.854700 4878 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
I20260809 18:59:21.856001 4086 ts_manager.cc:194] Registered new tserver with Master: e02e01601785452aa88e9a3cc2917cf0 (127.16.188.195:40175)
I20260809 18:59:21.856915 4086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:37211
I20260809 18:59:21.858127 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:21.859694 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 4210
Aug 09 18:59:21 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:59:21.875402 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.860600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38754 (local address 127.16.188.193:36171)
0809 18:59:21.861219 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:21.861225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:21.861247 (+ 22us) server_negotiation.cc:407] Connection header received
0809 18:59:21.861304 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:21.861309 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:21.861472 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:21.861588 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:21.863008 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.863991 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.865398 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.865916 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.866010 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:21.870113 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:21.870125 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:21.870137 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:21.870175 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:21.872698 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:21.873380 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:21.873387 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:21.873389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:21.873539 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:21.873879 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:21.873883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:21.873885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:21.874207 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:21.874491 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:21.874825 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 18:59:21.875083 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":257,"threads_started":1}
I20260809 18:59:21.876705 4409 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:21.957705 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 4210
I20260809 18:59:21.981753 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 4430
Aug 09 18:59:21 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:59:21.996649 4887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:21.982594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36610 (local address 127.16.188.194:42681)
0809 18:59:21.983116 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:21.983124 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:21.983150 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:59:21.983209 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:21.983215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:21.983425 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:21.983548 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:21.984741 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.985772 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.987136 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:21.987653 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:21.987744 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:21.991577 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:21.991587 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:21.991601 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:21.991639 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:21.994272 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:21.994899 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:21.994905 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:21.994907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:21.995033 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:21.995317 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:21.995320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:21.995322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:21.995641 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:21.995875 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:21.996073 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 18:59:21.996277 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":255,"threads_started":1}
I20260809 18:59:21.998025 4658 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:22.078504 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 4430
I20260809 18:59:22.098635 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 4675
Aug 09 18:59:22 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:59:22.114655 4890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:22.099506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53768 (local address 127.16.188.195:40175)
0809 18:59:22.100115 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:22.100123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:22.100154 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:59:22.100216 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:22.100222 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:22.100425 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:22.100548 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:22.101750 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:22.102869 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:22.104141 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:22.104712 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:22.104812 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:22.109201 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:22.109214 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:22.109230 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:22.109273 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:22.111817 (+ 2544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:22.112503 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:22.112511 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:22.112513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:22.112680 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:22.113034 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:22.113038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:22.113040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:22.113429 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:22.113752 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:22.114038 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 18:59:22.114305 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":283,"threads_started":1}
I20260809 18:59:22.115916 4872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:22.196486 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 4675
I20260809 18:59:22.216697 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 4021
I20260809 18:59:22.217871 4129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:22.322860 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 4021
I20260809 18:59:22.352451 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:36709
--webserver_interface=127.16.188.254
--webserver_port=45849
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:36709
--ranger_config_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:53625/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.188.212:53625/kms with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:22.684564 4894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:22.684864 4894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:22.685011 4894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:22.692091 4894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:22.692209 4894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:22.692294 4894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:22.692378 4894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:22.692452 4894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:22.702486 4894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.188.212:53625/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:36709
--ranger_config_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:36709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=45849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:22.703715 4894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:22.705281 4894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:22.716403 4900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:22.716447 4902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:22.716482 4904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:22.717198 4894 server_base.cc:1034] running on GCE node
I20260809 18:59:22.717916 4894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:22.719156 4894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:22.720350 4894 hybrid_clock.cc:648] HybridClock initialized: now 1786301962720294 us; error 49 us; skew 500 ppm
I20260809 18:59:22.720660 4894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:22 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301962, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:22.723474 4894 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:59:22.724754 4894 webserver.cc:460] Webserver started at http://127.16.188.254:45849/ using document root <none> and password file <none>
I20260809 18:59:22.725382 4894 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:22.725500 4894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:59:22 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301962, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:22.801038 4894 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 18:59:22.803929 4921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:22.805266 4894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:59:22.805445 4894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "06c366658bdf4ebf923ba28a5148be30"
format_stamp: "Formatted at 2026-08-09 18:59:18 on dist-test-slave-266d"
server_key: "afd52d4802ec909fc87ae1a77f1f6664"
server_key_iv: "2fe950b463683c58a54eb9be9a57fe21"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:22.806411 4894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:22.818959 4894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:22.822482 4894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:22.822726 4894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:22.839628 4894 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:36709
I20260809 18:59:22.839660 5007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:36709 every 8 connection(s)
I20260809 18:59:22.841073 4894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:22.847119 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 4894
I20260809 18:59:22.847764 5008 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:59:22.847994 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:53625/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:36171
--local_ip_for_outbound_sockets=127.16.188.193
--tserver_master_addrs=127.16.188.254:36709
--webserver_port=38371
--webserver_interface=127.16.188.193
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.188.212:53625/kms with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:22.850899 5008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Bootstrap starting.
I20260809 18:59:22.869033 5008 log.cc:824] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:22.877841 5008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:22.878336 5008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Bootstrap complete.
I20260809 18:59:22.886933 5008 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } }
I20260809 18:59:22.887748 5008 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c366658bdf4ebf923ba28a5148be30, State: Initialized, Role: FOLLOWER
I20260809 18:59:22.888295 5008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } }
I20260809 18:59:22.888504 5008 raft_consensus.cc:388] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:22.888612 5008 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:22.888767 5008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:59:22.892388 5008 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } }
I20260809 18:59:22.892839 5008 leader_election.cc:302] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06c366658bdf4ebf923ba28a5148be30; no voters:
I20260809 18:59:22.893442 5008 leader_election.cc:288] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:59:22.893596 5016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:59:22.894682 5016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [term 2 LEADER]: Becoming Leader. State: Replica: 06c366658bdf4ebf923ba28a5148be30, State: Running, Role: LEADER
I20260809 18:59:22.895219 5016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } }
I20260809 18:59:22.895520 5008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:22.897667 5018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "06c366658bdf4ebf923ba28a5148be30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } } }
I20260809 18:59:22.898038 5018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:22.900332 5020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06c366658bdf4ebf923ba28a5148be30. Latest consensus state: current_term: 2 leader_uuid: "06c366658bdf4ebf923ba28a5148be30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c366658bdf4ebf923ba28a5148be30" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 36709 } } }
I20260809 18:59:22.900622 5020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:22.902143 5028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:22.908303 5028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:22.909789 5028 catalog_manager.cc:1259] Loaded cluster ID: 08819364c8c740fcba2986513d142f14
I20260809 18:59:22.909929 5028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:22.913869 5028 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:22.915567 5028 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Loaded TSK: 0
I20260809 18:59:22.917248 5028 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:59:22.919494 5008 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260809 18:59:23.251446 5013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:23.251837 5013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:23.252007 5013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:23.263162 5013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:23.263293 5013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:23.263484 5013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:59:23.278422 5013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.188.212:53625/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:36171
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=38371
--tserver_master_addrs=127.16.188.254:36709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:23.280071 5013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:23.281814 5013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:23.300233 5071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:23.301951 5073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:23.305383 5070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:23.306526 5013 server_base.cc:1034] running on GCE node
I20260809 18:59:23.307298 5013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:23.308610 5013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:23.309866 5013 hybrid_clock.cc:648] HybridClock initialized: now 1786301963309790 us; error 51 us; skew 500 ppm
I20260809 18:59:23.310338 5013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:23 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301963, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:23.314997 5013 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:59:23.320139 5013 webserver.cc:460] Webserver started at http://127.16.188.193:38371/ using document root <none> and password file <none>
I20260809 18:59:23.321163 5013 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:23.321352 5013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:59:23 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301963, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:23.362252 5013 fs_manager.cc:709] Time spent opening directory manager: real 0.013s user 0.010s sys 0.001s
I20260809 18:59:23.366582 5085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:23.368580 5013 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 18:59:23.368870 5013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "5792b939e4e64449bd0a2619705273d7"
format_stamp: "Formatted at 2026-08-09 18:59:20 on dist-test-slave-266d"
server_key: "9639607ce334d73f931232de0c11b49d"
server_key_iv: "2a3cce28dad6eba6d635d106d0ea8268"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:23.370628 5013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:23.428105 5013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:23.433869 5013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:23.434310 5013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:23.439146 5013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:23.441256 5013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:23.441367 5013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:23.441505 5013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:23.441603 5013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:23.519534 5013 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:36171
I20260809 18:59:23.519587 5289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:36171 every 8 connection(s)
I20260809 18:59:23.521054 5013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:23.527999 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 5013
I20260809 18:59:23.528795 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:53625/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:42681
--local_ip_for_outbound_sockets=127.16.188.194
--tserver_master_addrs=127.16.188.254:36709
--webserver_port=41981
--webserver_interface=127.16.188.194
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.188.212:53625/kms with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:59:23 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301963, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:23.575222 5295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:23.524662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36709 (local address 127.16.188.193:59801)
0809 18:59:23.542671 (+ 18009us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:23.542729 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:23.545239 (+ 2510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:23.547142 (+ 1903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:23.547153 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:23.547757 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:23.548513 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:23.548537 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:23.550723 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:23.550728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:23.552757 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:23.552774 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:23.554243 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:23.554252 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:23.554532 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:23.555315 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:23.555347 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:23.565346 (+ 9999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:23.569763 (+ 4417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:23.569772 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:23.569789 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:23.570417 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:23.570983 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:23.570987 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:23.570991 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:23.571265 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:23.572436 (+ 1171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:23.572445 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:23.572861 (+ 416us) client_negotiation.cc:769] Sending connection context
0809 18:59:23.573241 (+ 380us) client_negotiation.cc:240] Negotiation successful
0809 18:59:23.573825 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17695,"thread_start_us":17445,"threads_started":1}
I20260809 18:59:23.575220 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:23.525951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:59801 (local address 127.16.188.254:36709)
0809 18:59:23.541982 (+ 16031us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:23.542009 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:23.545214 (+ 3205us) server_negotiation.cc:407] Connection header received
0809 18:59:23.545986 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:23.546009 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:23.546553 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:23.546975 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:23.548757 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:23.550530 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:23.552933 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:23.553973 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:23.554154 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:23.565669 (+ 11515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:23.565680 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:23.565703 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:23.565766 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:23.569589 (+ 3823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:23.570605 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:23.570615 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:23.570624 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:23.570831 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:23.571410 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:23.571415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:23.571419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:23.572147 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:23.572337 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:23.573511 (+ 1174us) server_negotiation.cc:299] Negotiation successful
0809 18:59:23.573930 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15725,"thread_start_us":15497,"threads_started":1}
I20260809 18:59:23.579090 5293 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36709
I20260809 18:59:23.579383 5293 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:23.580076 5293 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
W20260809 18:59:23.582965 5293 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:36709 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:59:23.583216 5293 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:23.583516 5293 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
I20260809 18:59:23.584818 5293 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:23.585175 5293 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
W20260809 18:59:23.586302 5293 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:59:23.927006 5298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:23.927287 5298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:23.927430 5298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:23.935964 5298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:23.936074 5298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:23.936224 5298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:59:23.947513 5298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.188.212:53625/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:42681
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=41981
--tserver_master_addrs=127.16.188.254:36709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:23.948841 5298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:23.950709 5298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:23.969475 5315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:23.971511 5316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:23.971700 5298 server_base.cc:1034] running on GCE node
W20260809 18:59:23.972266 5321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:23.972950 5298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:23.973954 5298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:23.975200 5298 hybrid_clock.cc:648] HybridClock initialized: now 1786301963975149 us; error 46 us; skew 500 ppm
I20260809 18:59:23.975500 5298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:23 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301963, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:23.982698 5298 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:59:23.984485 5298 webserver.cc:460] Webserver started at http://127.16.188.194:41981/ using document root <none> and password file <none>
I20260809 18:59:23.985256 5298 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:23.985396 5298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:59:23 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301963, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:24.019670 5298 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.007s sys 0.004s
I20260809 18:59:24.029418 5337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:24.031353 5298 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.003s sys 0.005s
I20260809 18:59:24.031646 5298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "0f94d111dd314b4496dcf0b16abcc23a"
format_stamp: "Formatted at 2026-08-09 18:59:21 on dist-test-slave-266d"
server_key: "d233d66232b939a38f98c0711ff936aa"
server_key_iv: "c78eb2dcf2b53353452a110ba8969b11"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:24.033217 5298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:24.059137 5298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:24.064213 5298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:24.064563 5298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:24.075697 5298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:24.080075 5298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:24.080178 5298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:24.080291 5298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:24.080416 5298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 18:59:24.121179 5298 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:42681
I20260809 18:59:24.121233 5526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:42681 every 8 connection(s)
I20260809 18:59:24.122814 5298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:24.126642 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 5298
I20260809 18:59:24.127437 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.188.212:53625/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:40175
--local_ip_for_outbound_sockets=127.16.188.195
--tserver_master_addrs=127.16.188.254:36709
--webserver_port=37439
--webserver_interface=127.16.188.195
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.188.212:53625/kms with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:59:24 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301963, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
Aug 09 18:59:24 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301964, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:24.167305 5532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.125751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:58515 (local address 127.16.188.254:36709)
0809 18:59:24.133473 (+ 7722us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:24.133479 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:24.134744 (+ 1265us) server_negotiation.cc:407] Connection header received
0809 18:59:24.137197 (+ 2453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:24.137202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:24.137291 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:24.137385 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:24.139352 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.140382 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.142654 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.143236 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.143357 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:24.148032 (+ 4675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:24.148050 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:24.148055 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:24.148094 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:24.151574 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:24.152457 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:24.152462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:24.152465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:24.152596 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:24.153055 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:24.153059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:24.153062 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:24.153425 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:24.153579 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:24.158057 (+ 4478us) server_negotiation.cc:299] Negotiation successful
0809 18:59:24.158284 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7589,"thread_start_us":7466,"threads_started":1}
I20260809 18:59:24.168879 5534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.126442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36709 (local address 127.16.188.194:58515)
0809 18:59:24.134542 (+ 8100us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:24.134600 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:24.136746 (+ 2146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:24.137810 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:24.137822 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:24.138371 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:24.139147 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:24.139171 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.140571 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.140576 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:24.142482 (+ 1906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:24.142497 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.143669 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.143677 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:24.143941 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:24.144850 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:24.144878 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:24.147802 (+ 2924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:24.151754 (+ 3952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:24.151764 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:24.151780 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:24.152325 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:24.152728 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:24.152732 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:24.152735 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:24.152934 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:24.153675 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:24.153684 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:24.155503 (+ 1819us) client_negotiation.cc:769] Sending connection context
0809 18:59:24.155817 (+ 314us) client_negotiation.cc:240] Negotiation successful
0809 18:59:24.156379 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7815,"thread_start_us":7596,"threads_started":1}
I20260809 18:59:24.174351 5528 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36709
I20260809 18:59:24.174683 5528 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:24.175555 5528 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
I20260809 18:59:24.177811 4946 ts_manager.cc:194] Registered new tserver with Master: 0f94d111dd314b4496dcf0b16abcc23a (127.16.188.194:42681)
I20260809 18:59:24.179921 4946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:58515
W20260809 18:59:24.526858 5535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:24.527347 5535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:24.527622 5535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:24.538928 5535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:24.539127 5535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:24.539366 5535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:59:24.554718 5535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.188.212:53625/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:40175
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=37439
--tserver_master_addrs=127.16.188.254:36709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:24.556640 5535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:24.558449 5535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:24.578737 5548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:24.582105 5547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:24.586470 5293 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:24.586944 5293 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
I20260809 18:59:24.590044 4946 ts_manager.cc:194] Registered new tserver with Master: 5792b939e4e64449bd0a2619705273d7 (127.16.188.193:36171)
I20260809 18:59:24.591202 4946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:59801
W20260809 18:59:24.600427 5554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:24.600638 5535 server_base.cc:1034] running on GCE node
I20260809 18:59:24.601598 5535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:24.603089 5535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:24.604404 5535 hybrid_clock.cc:648] HybridClock initialized: now 1786301964604335 us; error 45 us; skew 500 ppm
I20260809 18:59:24.604841 5535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:24 dist-test-slave-266d krb5kdc[3275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301964, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:24.608963 5535 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:59:24.611748 5535 webserver.cc:460] Webserver started at http://127.16.188.195:37439/ using document root <none> and password file <none>
Aug 09 18:59:24 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301964, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:24.612738 5535 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:24.612895 5535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:59:24 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301964, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:24.667689 5535 fs_manager.cc:709] Time spent opening directory manager: real 0.021s user 0.010s sys 0.009s
I20260809 18:59:24.689729 5564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:24.691700 5535 fs_manager.cc:725] Time spent opening block manager: real 0.022s user 0.020s sys 0.000s
I20260809 18:59:24.691985 5535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "e02e01601785452aa88e9a3cc2917cf0"
format_stamp: "Formatted at 2026-08-09 18:59:21 on dist-test-slave-266d"
server_key: "680c4d992801850091c4bd7f1c91ab5a"
server_key_iv: "93b43322966f0b0162cb76532cb871e2"
server_key_version: "kuduclusterkey@0"
I20260809 18:59:24.693578 5535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:24.743085 5535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:24.748622 5535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:24.748951 5535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:24.750275 5535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:24.751803 5535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:24.751904 5535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:24.752007 5535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:24.752080 5535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:24.806084 5535 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:40175
I20260809 18:59:24.806147 5757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:40175 every 8 connection(s)
I20260809 18:59:24.808090 5535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:24.817333 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 5535
Aug 09 18:59:24 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301964, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:24.862624 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.812503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:58439 (local address 127.16.188.254:36709)
0809 18:59:24.834438 (+ 21935us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:24.834445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:24.834470 (+ 25us) server_negotiation.cc:407] Connection header received
0809 18:59:24.836163 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:24.836169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:24.836256 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:24.836375 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:24.838712 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.839860 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.842172 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.842834 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.842936 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:24.854900 (+ 11964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:24.854907 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:24.854912 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:24.854961 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:24.858672 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:24.859644 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:24.859650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:24.859653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:24.859820 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:24.860427 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:24.860432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:24.860439 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:24.860805 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:24.860941 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:24.861983 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0809 18:59:24.862220 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21805,"thread_start_us":21975,"threads_started":1}
I20260809 18:59:24.865201 5766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.811937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:36709 (local address 127.16.188.195:58439)
0809 18:59:24.833134 (+ 21197us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:24.833200 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:24.835727 (+ 2527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:24.836822 (+ 1095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:24.836835 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:24.837497 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:24.838484 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:24.838510 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.840047 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.840053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:24.841999 (+ 1946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:24.842013 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.843229 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.843236 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:24.843491 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:24.851494 (+ 8003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:24.851534 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:24.854643 (+ 3109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:24.858841 (+ 4198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:24.858850 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:24.858869 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:24.859492 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:24.859986 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:24.859991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:24.859995 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:24.860276 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:24.861037 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:24.861046 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:24.861537 (+ 491us) client_negotiation.cc:769] Sending connection context
0809 18:59:24.863168 (+ 1631us) client_negotiation.cc:240] Negotiation successful
0809 18:59:24.863720 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20825,"thread_start_us":21107,"threads_started":1}
I20260809 18:59:24.867057 5762 heartbeater.cc:347] Connected to a master server at 127.16.188.254:36709
I20260809 18:59:24.867400 5762 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:24.868314 5762 heartbeater.cc:511] Master 127.16.188.254:36709 requested a full tablet report, sending...
I20260809 18:59:24.870083 4946 ts_manager.cc:194] Registered new tserver with Master: e02e01601785452aa88e9a3cc2917cf0 (127.16.188.195:40175)
I20260809 18:59:24.871182 4946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:58439
I20260809 18:59:24.871730 5770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.834660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38358 (local address 127.16.188.254:36709)
0809 18:59:24.853207 (+ 18547us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:24.853212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:24.853233 (+ 21us) server_negotiation.cc:407] Connection header received
0809 18:59:24.853283 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:24.853288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:24.853358 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:24.853472 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:24.856167 (+ 2695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.857865 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.859898 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.860569 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.863979 (+ 3410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:24.864232 (+ 253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:24.864239 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:24.864243 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:24.864275 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:24.867669 (+ 3394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:24.868528 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:24.868533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:24.868536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:24.868706 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:24.869170 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:24.869175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:24.869179 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:24.869526 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:24.870988 (+ 1462us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:24.871112 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 18:59:24.871346 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18391,"thread_start_us":18266,"threads_started":1}
I20260809 18:59:24.874909 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:24.899077 5770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.878713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38360 (local address 127.16.188.254:36709)
0809 18:59:24.878884 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:24.878889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:24.881653 (+ 2764us) server_negotiation.cc:407] Connection header received
0809 18:59:24.881824 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:24.881829 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:24.881904 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:24.881999 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:24.884041 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.885143 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.887061 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.887701 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.887830 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:24.891725 (+ 3895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:24.891732 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:24.891737 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:24.891778 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:24.895603 (+ 3825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:24.896470 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:24.896476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:24.896480 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:24.896642 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:24.897078 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:24.897083 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:24.897107 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:24.897451 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:24.897696 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:24.898296 (+ 600us) server_negotiation.cc:299] Negotiation successful
0809 18:59:24.898526 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:59:24.905524 4946 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:59:24.917471 4946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 09 18:59:24 dist-test-slave-266d krb5kdc[3275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301964, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for HTTP/127.16.188.212@KRBTEST.COM
I20260809 18:59:25.001963 5790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.949544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38768 (local address 127.16.188.193:36171)
0809 18:59:24.950195 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:24.950205 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:24.990710 (+ 40505us) server_negotiation.cc:407] Connection header received
0809 18:59:24.991125 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:24.991134 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:24.991405 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:24.991636 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:24.993406 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.994995 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.998585 (+ 3590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.000156 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.000342 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.000538 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.001384 (+ 846us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.001570 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":3580,"threads_started":1}
I20260809 18:59:25.002803 5787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.948242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38768)
0809 18:59:24.990515 (+ 42273us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:24.990555 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:24.990796 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:24.992328 (+ 1532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:24.992338 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:24.992383 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:24.993169 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:24.993186 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:24.995205 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:24.995211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:24.998205 (+ 2994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:24.998225 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.000784 (+ 2559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.000791 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.001044 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.001144 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 18:59:25.002213 (+ 1069us) client_negotiation.cc:240] Negotiation successful
0809 18:59:25.002439 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41996,"thread_start_us":43508,"threads_started":1}
I20260809 18:59:25.008577 5166 tablet_service.cc:1467] Processing CreateTablet for tablet f0e1a3f2bd41499092a28a375e604adb (DEFAULT_TABLE table=test-table [id=6cc8b469c8ae40da905400ccc972b541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:25.011132 5788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.948915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.16.188.195:40175)
0809 18:59:24.989677 (+ 40762us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:24.989689 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:24.995515 (+ 5826us) server_negotiation.cc:407] Connection header received
0809 18:59:24.998618 (+ 3103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:24.998627 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:24.998931 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:24.999171 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:25.001187 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.002881 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.008138 (+ 5257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.009584 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.009750 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.009927 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.010596 (+ 669us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.010762 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40519,"thread_start_us":40781,"threads_started":1}
I20260809 18:59:25.011638 5792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.992200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:42681 (local address 127.0.0.1:36622)
0809 18:59:25.001192 (+ 8992us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.001212 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:25.001320 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:25.004253 (+ 2933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:25.004257 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:25.004285 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:25.004570 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:25.004582 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.006524 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.006529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.008637 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:25.008653 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.010827 (+ 2174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.010834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.010999 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.011034 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:59:25.011139 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 18:59:25.011276 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8842,"thread_start_us":8684,"threads_started":1}
I20260809 18:59:25.012112 5166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e1a3f2bd41499092a28a375e604adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:25.012184 5786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.948376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:40175 (local address 127.0.0.1:53770)
0809 18:59:24.995376 (+ 47000us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:24.995396 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:24.998420 (+ 3024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:24.999613 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:24.999619 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:24.999651 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:25.000060 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:25.000071 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.005711 (+ 5640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.005716 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.007807 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:25.007823 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.010166 (+ 2343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.010173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.010339 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.010374 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:59:25.011390 (+ 1016us) client_negotiation.cc:240] Negotiation successful
0809 18:59:25.011532 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44324,"thread_start_us":41721,"threads_started":1}
I20260809 18:59:25.012912 5793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:24.993421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36622 (local address 127.16.188.194:42681)
0809 18:59:25.003372 (+ 9951us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:25.003381 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:25.003411 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:59:25.003510 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:25.003518 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:25.003783 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:25.003987 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:25.004781 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.006300 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.008823 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.010313 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.010469 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.010629 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.012418 (+ 1789us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.012583 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9777,"thread_start_us":10162,"threads_started":1}
I20260809 18:59:25.016129 5653 tablet_service.cc:1467] Processing CreateTablet for tablet f0e1a3f2bd41499092a28a375e604adb (DEFAULT_TABLE table=test-table [id=6cc8b469c8ae40da905400ccc972b541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:25.017691 5653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e1a3f2bd41499092a28a375e604adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:25.023469 5419 tablet_service.cc:1467] Processing CreateTablet for tablet f0e1a3f2bd41499092a28a375e604adb (DEFAULT_TABLE table=test-table [id=6cc8b469c8ae40da905400ccc972b541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:25.024843 5419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e1a3f2bd41499092a28a375e604adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:25.057898 5794 tablet_bootstrap.cc:492] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: Bootstrap starting.
I20260809 18:59:25.058785 5795 tablet_bootstrap.cc:492] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7: Bootstrap starting.
I20260809 18:59:25.064747 5795 tablet_bootstrap.cc:654] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:25.067008 5796 tablet_bootstrap.cc:492] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Bootstrap starting.
I20260809 18:59:25.068667 5794 tablet_bootstrap.cc:654] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:25.070044 5794 log.cc:824] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:25.071851 5796 tablet_bootstrap.cc:654] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:25.073184 5796 log.cc:824] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:25.074137 5795 log.cc:824] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:25.080268 5796 tablet_bootstrap.cc:492] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: No bootstrap required, opened a new log
I20260809 18:59:25.080686 5796 ts_tablet_manager.cc:1397] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260809 18:59:25.084898 5795 tablet_bootstrap.cc:492] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7: No bootstrap required, opened a new log
I20260809 18:59:25.085242 5795 ts_tablet_manager.cc:1397] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.006s
I20260809 18:59:25.090914 5796 raft_consensus.cc:348] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
I20260809 18:59:25.091465 5796 raft_consensus.cc:374] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:25.091629 5796 raft_consensus.cc:729] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f94d111dd314b4496dcf0b16abcc23a, State: Initialized, Role: FOLLOWER
I20260809 18:59:25.092423 5796 consensus_queue.cc:260] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
I20260809 18:59:25.093026 5794 tablet_bootstrap.cc:492] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: No bootstrap required, opened a new log
I20260809 18:59:25.093375 5794 ts_tablet_manager.cc:1397] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.008s
I20260809 18:59:25.103133 5796 ts_tablet_manager.cc:1428] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Time spent starting tablet: real 0.022s user 0.011s sys 0.009s
I20260809 18:59:25.105530 5794 raft_consensus.cc:348] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
I20260809 18:59:25.105841 5528 heartbeater.cc:503] Master 127.16.188.254:36709 was elected leader, sending a full tablet report...
I20260809 18:59:25.106045 5794 raft_consensus.cc:374] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:25.106209 5794 raft_consensus.cc:729] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e02e01601785452aa88e9a3cc2917cf0, State: Initialized, Role: FOLLOWER
I20260809 18:59:25.106966 5794 consensus_queue.cc:260] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
I20260809 18:59:25.110195 5795 raft_consensus.cc:348] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
I20260809 18:59:25.110814 5795 raft_consensus.cc:374] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:25.110946 5795 raft_consensus.cc:729] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5792b939e4e64449bd0a2619705273d7, State: Initialized, Role: FOLLOWER
I20260809 18:59:25.111613 5795 consensus_queue.cc:260] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
I20260809 18:59:25.126314 5762 heartbeater.cc:503] Master 127.16.188.254:36709 was elected leader, sending a full tablet report...
I20260809 18:59:25.129295 5807 raft_consensus.cc:482] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:25.129680 5795 ts_tablet_manager.cc:1428] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7: Time spent starting tablet: real 0.044s user 0.011s sys 0.009s
I20260809 18:59:25.129570 5807 raft_consensus.cc:504] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
W20260809 18:59:25.135313 5531 tablet.cc:2369] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:25.137995 5807 leader_election.cc:288] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5792b939e4e64449bd0a2619705273d7 (127.16.188.193:36171), 0f94d111dd314b4496dcf0b16abcc23a (127.16.188.194:42681)
I20260809 18:59:25.140916 5766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.132098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.16.188.195:34475)
0809 18:59:25.132241 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.132259 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:25.132376 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:25.133362 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:25.133368 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:25.133399 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:25.133622 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:25.133633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.136092 (+ 2459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.136098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.138197 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:25.138232 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.140190 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.140196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.140402 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.140435 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 18:59:25.140524 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:59:25.140669 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:59:25.141603 5790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.131718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:34475 (local address 127.16.188.193:36171)
0809 18:59:25.131920 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:25.131926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:25.132493 (+ 567us) server_negotiation.cc:407] Connection header received
0809 18:59:25.132572 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:25.132578 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:25.132674 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:25.132762 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:25.133795 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.134960 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.138524 (+ 3564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.139780 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.139928 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.140001 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.141211 (+ 1210us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.141357 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 18:59:25.149209 5793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.133077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:43981 (local address 127.16.188.194:42681)
0809 18:59:25.133277 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:25.133283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:25.142167 (+ 8884us) server_negotiation.cc:407] Connection header received
0809 18:59:25.142493 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:25.142500 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:25.142602 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:25.142664 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:25.143223 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.144354 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.146692 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.147971 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.148094 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.148180 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.148781 (+ 601us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.148926 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:59:25.149997 5766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.132609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:42681 (local address 127.16.188.195:43981)
0809 18:59:25.142075 (+ 9466us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.142094 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:25.142339 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:25.142857 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:25.142863 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:25.142888 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:25.143068 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:25.143077 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.144544 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.144550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.146485 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:25.146500 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.148336 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.148342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:25.148577 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.148627 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 18:59:25.149611 (+ 984us) client_negotiation.cc:240] Negotiation successful
0809 18:59:25.149734 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9366,"threads_started":1}
I20260809 18:59:25.152245 5293 heartbeater.cc:503] Master 127.16.188.254:36709 was elected leader, sending a full tablet report...
I20260809 18:59:25.141402 5794 ts_tablet_manager.cc:1428] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: Time spent starting tablet: real 0.048s user 0.009s sys 0.013s
I20260809 18:59:25.158346 5452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e1a3f2bd41499092a28a375e604adb" candidate_uuid: "e02e01601785452aa88e9a3cc2917cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f94d111dd314b4496dcf0b16abcc23a" is_pre_election: true
I20260809 18:59:25.158928 5452 raft_consensus.cc:2454] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e02e01601785452aa88e9a3cc2917cf0 in term 0.
I20260809 18:59:25.159687 5206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e1a3f2bd41499092a28a375e604adb" candidate_uuid: "e02e01601785452aa88e9a3cc2917cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5792b939e4e64449bd0a2619705273d7" is_pre_election: true
I20260809 18:59:25.160128 5206 raft_consensus.cc:2454] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e02e01601785452aa88e9a3cc2917cf0 in term 0.
I20260809 18:59:25.160748 5571 leader_election.cc:302] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f94d111dd314b4496dcf0b16abcc23a, e02e01601785452aa88e9a3cc2917cf0; no voters:
I20260809 18:59:25.161464 5806 raft_consensus.cc:2781] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:25.161618 5806 raft_consensus.cc:482] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:25.161756 5806 raft_consensus.cc:3037] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:25.164785 5806 raft_consensus.cc:504] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
I20260809 18:59:25.165405 5806 leader_election.cc:288] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [CANDIDATE]: Term 1 election: Requested vote from peers 5792b939e4e64449bd0a2619705273d7 (127.16.188.193:36171), 0f94d111dd314b4496dcf0b16abcc23a (127.16.188.194:42681)
I20260809 18:59:25.165725 5206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e1a3f2bd41499092a28a375e604adb" candidate_uuid: "e02e01601785452aa88e9a3cc2917cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5792b939e4e64449bd0a2619705273d7"
I20260809 18:59:25.165899 5206 raft_consensus.cc:3037] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:25.169061 5206 raft_consensus.cc:2454] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e02e01601785452aa88e9a3cc2917cf0 in term 1.
I20260809 18:59:25.170293 5452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e1a3f2bd41499092a28a375e604adb" candidate_uuid: "e02e01601785452aa88e9a3cc2917cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f94d111dd314b4496dcf0b16abcc23a"
I20260809 18:59:25.170497 5452 raft_consensus.cc:3037] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:25.172560 5452 raft_consensus.cc:2454] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e02e01601785452aa88e9a3cc2917cf0 in term 1.
I20260809 18:59:25.172914 5571 leader_election.cc:302] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5792b939e4e64449bd0a2619705273d7, e02e01601785452aa88e9a3cc2917cf0; no voters:
I20260809 18:59:25.173187 5806 raft_consensus.cc:2781] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:25.173353 5806 raft_consensus.cc:686] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 1 LEADER]: Becoming Leader. State: Replica: e02e01601785452aa88e9a3cc2917cf0, State: Running, Role: LEADER
I20260809 18:59:25.173830 5806 consensus_queue.cc:237] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } }
I20260809 18:59:25.178614 4946 catalog_manager.cc:5495] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e02e01601785452aa88e9a3cc2917cf0 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "e02e01601785452aa88e9a3cc2917cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e02e01601785452aa88e9a3cc2917cf0" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 } health_report { overall_health: UNKNOWN } } }
I20260809 18:59:25.202973 5788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.197216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53776 (local address 127.16.188.195:40175)
0809 18:59:25.197432 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:25.197439 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:25.197563 (+ 124us) server_negotiation.cc:407] Connection header received
0809 18:59:25.197787 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:25.197792 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:25.197870 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:25.197997 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:25.198371 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.199113 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.200789 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.201220 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.201325 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.201832 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:25.202391 (+ 559us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:25.202526 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.202654 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.202732 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:59:25.211117 5452 raft_consensus.cc:1261] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 1 FOLLOWER]: Refusing update from remote peer e02e01601785452aa88e9a3cc2917cf0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:25.212529 5206 raft_consensus.cc:1261] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 1 FOLLOWER]: Refusing update from remote peer e02e01601785452aa88e9a3cc2917cf0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:25.213127 5806 consensus_queue.cc:1035] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f94d111dd314b4496dcf0b16abcc23a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:25.213836 5806 consensus_queue.cc:1035] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5792b939e4e64449bd0a2619705273d7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:25.275475 4945 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:25.275982 4945 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:25.280969 4945 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 06c366658bdf4ebf923ba28a5148be30: Sending DeleteTablet for 3 replicas of tablet f0e1a3f2bd41499092a28a375e604adb
I20260809 18:59:25.282425 5653 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e1a3f2bd41499092a28a375e604adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:25 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:53770
I20260809 18:59:25.282424 5166 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e1a3f2bd41499092a28a375e604adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:25 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:38768
I20260809 18:59:25.283746 5419 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e1a3f2bd41499092a28a375e604adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:25 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:36622
I20260809 18:59:25.290951 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 5013
I20260809 18:59:25.307124 5790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.291945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38774 (local address 127.16.188.193:36171)
0809 18:59:25.292113 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:25.292118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:25.292138 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:59:25.292316 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:25.292321 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:25.292385 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:25.292465 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:25.294214 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.294989 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.297018 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.297501 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.297622 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.300957 (+ 3335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:25.300971 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:25.300985 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:25.301021 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:25.303998 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:25.304833 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:25.304841 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:25.304843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:25.305020 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:25.305468 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:25.305473 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:25.305476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:25.305956 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:25.306238 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.306555 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.306790 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 18:59:25.307839 5284 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:25.309755 5847 tablet_replica.cc:330] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: stopping tablet replica
I20260809 18:59:25.310365 5847 raft_consensus.cc:2229] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:25.311082 5847 raft_consensus.cc:2258] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:25.311962 5843 tablet_replica.cc:330] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: stopping tablet replica
I20260809 18:59:25.314038 5847 ts_tablet_manager.cc:1905] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:25.315065 5843 raft_consensus.cc:2229] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:59:25.322336 5843 raft_consensus.cc:2258] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:25.325868 5843 ts_tablet_manager.cc:1905] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:25.336648 5843 ts_tablet_manager.cc:1918] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:25.338109 5847 ts_tablet_manager.cc:1918] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:25.338589 5847 log.cc:1196] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/f0e1a3f2bd41499092a28a375e604adb
I20260809 18:59:25.339308 5847 ts_tablet_manager.cc:1939] T f0e1a3f2bd41499092a28a375e604adb P 0f94d111dd314b4496dcf0b16abcc23a: Deleting consensus metadata
I20260809 18:59:25.341593 4930 catalog_manager.cc:4841] TS 0f94d111dd314b4496dcf0b16abcc23a (127.16.188.194:42681): tablet f0e1a3f2bd41499092a28a375e604adb (table test-table [id=6cc8b469c8ae40da905400ccc972b541]) successfully deleted
I20260809 18:59:25.342319 5843 log.cc:1196] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/f0e1a3f2bd41499092a28a375e604adb
I20260809 18:59:25.343134 5843 ts_tablet_manager.cc:1939] T f0e1a3f2bd41499092a28a375e604adb P e02e01601785452aa88e9a3cc2917cf0: Deleting consensus metadata
I20260809 18:59:25.345166 4923 catalog_manager.cc:4841] TS e02e01601785452aa88e9a3cc2917cf0 (127.16.188.195:40175): tablet f0e1a3f2bd41499092a28a375e604adb (table test-table [id=6cc8b469c8ae40da905400ccc972b541]) successfully deleted
I20260809 18:59:25.491089 5844 tablet_replica.cc:330] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7: stopping tablet replica
I20260809 18:59:25.491602 5844 raft_consensus.cc:2229] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:25.492214 5844 raft_consensus.cc:2258] T f0e1a3f2bd41499092a28a375e604adb P 5792b939e4e64449bd0a2619705273d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:25.493151 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 5013
I20260809 18:59:25.526655 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 5298
W20260809 18:59:25.526721 4930 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.188.193:36171 (error 108)
I20260809 18:59:25.546613 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.539774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38784)
0809 18:59:25.546268 (+ 6494us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.546415 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6354,"threads_started":1}
W20260809 18:59:25.547031 4930 catalog_manager.cc:4584] TS 5792b939e4e64449bd0a2619705273d7 (127.16.188.193:36171): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f0e1a3f2bd41499092a28a375e604adb: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
I20260809 18:59:25.550467 5793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.527720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36636 (local address 127.16.188.194:42681)
0809 18:59:25.528323 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:25.528329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:25.528348 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:59:25.528410 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:25.528416 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:25.528492 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:25.528583 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:25.530558 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.531650 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.533691 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.534298 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.534406 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.543055 (+ 8649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:25.543086 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:25.543105 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:25.543155 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:25.547114 (+ 3959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:25.548059 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:25.548069 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:25.548072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:25.548244 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:25.548683 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:25.548688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:25.548691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:25.549200 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:25.549612 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.549852 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.550084 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472}
I20260809 18:59:25.551282 5519 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:25.600872 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.600232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38798)
0809 18:59:25.600462 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.600591 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 18:59:25.602129 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.601690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38814)
0809 18:59:25.601847 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.601956 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 18:59:25.649403 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 5298
I20260809 18:59:25.663013 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.662488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38820)
0809 18:59:25.662730 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.662840 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 18:59:25.664264 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.663802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38836)
0809 18:59:25.663981 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.664081 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 18:59:25.672849 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 5535
I20260809 18:59:25.688449 5788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.673636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53780 (local address 127.16.188.195:40175)
0809 18:59:25.673799 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:25.673806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:25.673825 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:59:25.674032 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:25.674036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:25.674101 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:25.674192 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:25.675903 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.676753 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.678666 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:25.679107 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:25.679213 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:25.682470 (+ 3257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:25.682483 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:25.682499 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:25.682541 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:25.685601 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:25.686398 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:25.686405 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:25.686407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:25.686606 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:25.687005 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:25.687008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:25.687010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:25.687372 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:25.687631 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:25.687970 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 18:59:25.688131 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 18:59:25.689174 5751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:25.745076 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.744606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38850)
0809 18:59:25.744828 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.744922 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 18:59:25.746228 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.745827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38854)
0809 18:59:25.746021 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.746098 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260809 18:59:25.810616 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 5535
I20260809 18:59:25.835923 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 4894
I20260809 18:59:25.837157 5000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:25.962314 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:25.961831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36171 (local address 127.0.0.1:38856)
0809 18:59:25.962026 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:25.962129 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 18:59:25.962407 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 4894
I20260809 18:59:25.990561 17139 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 18:59:26.335070 17139 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 18:59:26.335274 17139 mini_ranger.cc:66] Stopping Ranger...
I20260809 18:59:26.679597 17139 mini_ranger.cc:68] Stopped Ranger
2026-08-09 18:59:26.679 UTC [3319] LOG: received smart shutdown request
2026-08-09 18:59:26.682 UTC [3319] LOG: background worker "logical replication launcher" (PID 3334) exited with exit code 1
2026-08-09 18:59:26.682 UTC [3325] LOG: shutting down
2026-08-09 18:59:26.819 UTC [3319] LOG: database system is shut down
2026-08-09T18:59:26Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51220 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:59:27 dist-test-slave-266d krb5kdc[5873](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:59:27 dist-test-slave-266d krb5kdc[5873](info): set up 2 sockets
Aug 09 18:59:27 dist-test-slave-266d krb5kdc[5873](info): commencing operation
krb5kdc: starting...
W20260809 18:59:28.162253 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.001s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:59:28 dist-test-slave-266d krb5kdc[5873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:59:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:59:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:59:28.396212 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:38459
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:38459,127.16.188.253:38131,127.16.188.252:38937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:28.731510 5894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:28.731789 5894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:28.731886 5894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:28.738845 5894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:28.738945 5894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:28.738997 5894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:28.739053 5894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:28.739097 5894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:28.748422 5894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:38459,127.16.188.253:38131,127.16.188.252:38937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:38459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:28.749634 5894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:28.750826 5894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:28.761859 5900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:28.761896 5906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:28.761816 5901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:28.762748 5894 server_base.cc:1034] running on GCE node
I20260809 18:59:28.763455 5894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:28.764710 5894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:28.765901 5894 hybrid_clock.cc:648] HybridClock initialized: now 1786301968765857 us; error 32 us; skew 500 ppm
I20260809 18:59:28.766214 5894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:28 dist-test-slave-266d krb5kdc[5873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301968, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:28.769173 5894 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:59:28.770532 5894 webserver.cc:460] Webserver started at http://127.16.188.254:33397/ using document root <none> and password file <none>
I20260809 18:59:28.771149 5894 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:28.771270 5894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:28.771556 5894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:28.774392 5894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "29abfd9316354ec4a61f620acd559ba2"
format_stamp: "Formatted at 2026-08-09 18:59:28 on dist-test-slave-266d"
server_key: "a1fb51def6e4814304acb5a60be47be8"
server_key_iv: "30f34080d4e201a0e5474b134bbe8682"
server_key_version: "encryptionkey@0"
I20260809 18:59:28.775157 5894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "29abfd9316354ec4a61f620acd559ba2"
format_stamp: "Formatted at 2026-08-09 18:59:28 on dist-test-slave-266d"
server_key: "a1fb51def6e4814304acb5a60be47be8"
server_key_iv: "30f34080d4e201a0e5474b134bbe8682"
server_key_version: "encryptionkey@0"
I20260809 18:59:28.780085 5894 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 18:59:28.783607 5919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:28.784789 5894 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:28.784945 5894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "29abfd9316354ec4a61f620acd559ba2"
format_stamp: "Formatted at 2026-08-09 18:59:28 on dist-test-slave-266d"
server_key: "a1fb51def6e4814304acb5a60be47be8"
server_key_iv: "30f34080d4e201a0e5474b134bbe8682"
server_key_version: "encryptionkey@0"
I20260809 18:59:28.785143 5894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:28.796170 5894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:28.800078 5894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:28.800345 5894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:28.817409 5894 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:38459
I20260809 18:59:28.817440 5997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:38459 every 8 connection(s)
I20260809 18:59:28.818727 5894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:28.822374 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:28.828689 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 5894
I20260809 18:59:28.828888 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:59:28.828784 5998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:28.829553 17139 external_mini_cluster.cc:1428] Setting key 8bd17bf4dcceab692e869f8c21ce51c2
Aug 09 18:59:28 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301968, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:28.851822 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.831922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38459 (local address 127.0.0.1:36120)
0809 18:59:28.832785 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.832838 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:28.835147 (+ 2309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:28.835999 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:28.836006 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:28.836710 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:28.837176 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:28.837200 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:28.838819 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:28.838825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:28.840263 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:28.840278 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:28.841469 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:28.841474 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:28.841594 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:28.842215 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:28.842236 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:28.844487 (+ 2251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:28.848183 (+ 3696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:28.848193 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:28.848202 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:28.848587 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:28.849040 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:28.849043 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:28.849045 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:28.849218 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:28.850038 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:28.850044 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:28.850230 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 18:59:28.850427 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 18:59:28.850791 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":368,"threads_started":1}
I20260809 18:59:28.851847 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.831922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36120 (local address 127.16.188.254:38459)
0809 18:59:28.833685 (+ 1763us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:28.833691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:28.833737 (+ 46us) server_negotiation.cc:407] Connection header received
0809 18:59:28.835524 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:28.835529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:28.835764 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:28.835917 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:28.837381 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:28.838658 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:28.840406 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:28.841265 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:28.841457 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:28.844730 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:28.844740 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:28.844753 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:28.844787 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:28.848043 (+ 3256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:28.848723 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:28.848733 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:28.848737 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:28.848934 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:28.849316 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:28.849321 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:28.849323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:28.849930 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:28.850143 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:28.850618 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 18:59:28.850942 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":1573,"spinlock_wait_cycles":86272,"thread_start_us":1332,"threads_started":1}
I20260809 18:59:28.854734 5998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:28.855837 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.855466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42390)
0809 18:59:28.855626 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.855727 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 18:59:28.856088 5921 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.16.188.253@KRBTEST.COM; defaulting to no policy
I20260809 18:59:28.857654 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.857254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42394)
0809 18:59:28.857411 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.857511 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 18:59:28.857851 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:38131: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab.
Entry for principal kudu/127.16.188.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab.
I20260809 18:59:28.887930 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.253:38131
--webserver_interface=127.16.188.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab
--principal=kudu/127.16.188.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:38459,127.16.188.253:38131,127.16.188.252:38937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:28.907217 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } attempt: 1
I20260809 18:59:28.908481 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.908001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42396)
0809 18:59:28.908213 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.908337 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 18:59:28.909427 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.909068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42406)
0809 18:59:28.909222 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.909301 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 18:59:28.909605 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:38131: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
I20260809 18:59:28.977852 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } attempt: 2
I20260809 18:59:28.978956 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.978474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42414)
0809 18:59:28.978711 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.978815 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 18:59:28.979902 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:28.979549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42420)
0809 18:59:28.979691 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:28.979770 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 18:59:28.980080 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:38131: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
I20260809 18:59:29.071317 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } attempt: 3
I20260809 18:59:29.072456 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.072038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42436)
0809 18:59:29.072225 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.072324 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 18:59:29.073443 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.073063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42446)
0809 18:59:29.073219 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.073313 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 18:59:29.073616 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:38131: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
W20260809 18:59:29.209304 6007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:29.209583 6007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:29.209708 6007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:29.216693 6007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:29.216800 6007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:29.216878 6007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:29.216960 6007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260809 18:59:29.216838 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } attempt: 4
W20260809 18:59:29.217022 6007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:29.217933 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.217434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42450)
0809 18:59:29.217715 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.217804 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260809 18:59:29.218883 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.218509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42464)
0809 18:59:29.218648 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.218748 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 18:59:29.219045 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:38131: Network error: Client connection negotiation failed: client connection to 127.16.188.253:38131: connect: Connection refused (error 111)
I20260809 18:59:29.226588 6007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:38459,127.16.188.253:38131,127.16.188.252:38937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab
--principal=kudu/127.16.188.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.253:38131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.188.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:29.227794 6007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:29.229110 6007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:29.240091 6019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:29.240070 6022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:29.240120 6018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:29.240891 6007 server_base.cc:1034] running on GCE node
I20260809 18:59:29.241623 6007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:29.242858 6007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:29.244053 6007 hybrid_clock.cc:648] HybridClock initialized: now 1786301969244002 us; error 39 us; skew 500 ppm
I20260809 18:59:29.244428 6007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301969, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:29.250738 6007 init.cc:377] Logged in from keytab as kudu/127.16.188.253@KRBTEST.COM (short username kudu)
I20260809 18:59:29.252141 6007 webserver.cc:460] Webserver started at http://127.16.188.253:32817/ using document root <none> and password file <none>
I20260809 18:59:29.252797 6007 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:29.252905 6007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:29.253224 6007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:29.256203 6007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/data/instance:
uuid: "f5df804a78f9499aa89e1fc491940a58"
format_stamp: "Formatted at 2026-08-09 18:59:29 on dist-test-slave-266d"
server_key: "9e67e2eda974ce589c9db151f585fcf1"
server_key_iv: "de1b2e3332985c8ed84b4a96ad71927f"
server_key_version: "encryptionkey@0"
I20260809 18:59:29.257020 6007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/wal/instance:
uuid: "f5df804a78f9499aa89e1fc491940a58"
format_stamp: "Formatted at 2026-08-09 18:59:29 on dist-test-slave-266d"
server_key: "9e67e2eda974ce589c9db151f585fcf1"
server_key_iv: "de1b2e3332985c8ed84b4a96ad71927f"
server_key_version: "encryptionkey@0"
I20260809 18:59:29.262149 6007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 18:59:29.265457 6033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:29.266692 6007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 18:59:29.266834 6007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/wal
uuid: "f5df804a78f9499aa89e1fc491940a58"
format_stamp: "Formatted at 2026-08-09 18:59:29 on dist-test-slave-266d"
server_key: "9e67e2eda974ce589c9db151f585fcf1"
server_key_iv: "de1b2e3332985c8ed84b4a96ad71927f"
server_key_version: "encryptionkey@0"
I20260809 18:59:29.267000 6007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:29.287945 6007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:29.291689 6007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:29.291936 6007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:29.310169 6007 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.253:38131
I20260809 18:59:29.310176 6112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.253:38131 every 8 connection(s)
I20260809 18:59:29.311465 6007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
I20260809 18:59:29.314944 6113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:29.320356 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 6007
I20260809 18:59:29.320523 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-1/wal/instance
I20260809 18:59:29.320974 17139 external_mini_cluster.cc:1428] Setting key b44dc8c7835ee472b6b79b7bdfafd6db
I20260809 18:59:29.321174 6113 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301969, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:29.339835 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.323549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36132 (local address 127.16.188.254:38459)
0809 18:59:29.323707 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.323711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.325020 (+ 1309us) server_negotiation.cc:407] Connection header received
0809 18:59:29.326804 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.326810 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.326888 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.326976 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.328382 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.329048 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.330553 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.330961 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.331075 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.334396 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.334401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.334404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.334437 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.336971 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.337645 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.337652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.337655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.337776 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.338163 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.338166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.338169 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.338458 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.338590 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.339296 (+ 706us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.339529 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:59:29.340677 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.324156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38459 (local address 127.0.0.1:36132)
0809 18:59:29.324873 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.324908 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:29.326549 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:29.327200 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:29.327208 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:29.327695 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:29.328217 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.328232 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.329231 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.329235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.330413 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.330425 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.331179 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.331186 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.331390 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.331976 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:29.332001 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:29.334180 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:29.337114 (+ 2934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.337123 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.337137 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.337534 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.337876 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.337880 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.337884 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.338052 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.338578 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:29.338586 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:29.338921 (+ 335us) client_negotiation.cc:769] Sending connection context
0809 18:59:29.339145 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 18:59:29.339595 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":309,"threads_started":1}
I20260809 18:59:29.342398 6113 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.188.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.252@KRBTEST.COM" created.
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301969, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 18:59:29.356803 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.343156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42478)
0809 18:59:29.343342 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.343361 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:29.343459 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:29.344369 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:29.344373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:29.344759 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:29.344894 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.344902 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.346311 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.346317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.347292 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.347305 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.348322 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.348326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.348477 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.349017 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:29.349035 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:29.350905 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:29.354497 (+ 3592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.354500 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.354503 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.354868 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.355252 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.355256 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.355258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.355404 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.356071 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:29.356076 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:29.356199 (+ 123us) client_negotiation.cc:769] Sending connection context
0809 18:59:29.356335 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 18:59:29.356533 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 18:59:29.357138 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.343323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42478 (local address 127.16.188.253:38131)
0809 18:59:29.343977 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.343982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.344006 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:59:29.344045 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.344050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.344228 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.344357 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.345065 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.346161 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.347422 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.348170 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.348285 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.351121 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.351134 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.351150 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.351187 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.354346 (+ 3159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.354994 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.355003 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.355006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.355147 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.355497 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.355501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.355504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.355925 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.356137 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.356492 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.356725 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":373,"threads_started":1}
I20260809 18:59:29.359583 6113 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:29.360600 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.360186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60830)
0809 18:59:29.360346 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.360450 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 18:59:29.360821 6034 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
I20260809 18:59:29.362332 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.361998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60842)
0809 18:59:29.362168 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.362239 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 18:59:29.362522 6113 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab.
Entry for principal kudu/127.16.188.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab.
I20260809 18:59:29.378165 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.252:38937
--webserver_interface=127.16.188.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab
--principal=kudu/127.16.188.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:38459,127.16.188.253:38131,127.16.188.252:38937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:29.411787 6113 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 1
I20260809 18:59:29.412976 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.412519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60858)
0809 18:59:29.412715 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.412826 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 18:59:29.413973 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.413635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60860)
0809 18:59:29.413794 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.413863 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 18:59:29.414160 6113 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
I20260809 18:59:29.482369 6113 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 2
I20260809 18:59:29.483373 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.482943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60876)
0809 18:59:29.483133 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.483223 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 18:59:29.484377 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.484055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60878)
0809 18:59:29.484195 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.484261 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 18:59:29.484573 6113 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
I20260809 18:59:29.518275 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } attempt: 5
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301968, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 18:59:29.531951 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.518914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42486)
0809 18:59:29.519098 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.519118 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:29.519227 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:29.519599 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:29.519602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:29.519964 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:29.520151 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.520161 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.521577 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.521580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.522447 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.522459 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.523444 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.523448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.523579 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.524189 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:29.524205 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:29.526293 (+ 2088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:29.529865 (+ 3572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.529869 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.529872 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.530199 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.530559 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.530562 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.530564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.530685 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.531280 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:29.531283 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:29.531406 (+ 123us) client_negotiation.cc:769] Sending connection context
0809 18:59:29.531507 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 18:59:29.531710 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 18:59:29.532205 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.519029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42486 (local address 127.16.188.253:38131)
0809 18:59:29.519235 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.519242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.519304 (+ 62us) server_negotiation.cc:407] Connection header received
0809 18:59:29.519371 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.519376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.519472 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.519583 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.520321 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.521466 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.522596 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.523306 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.523444 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.526481 (+ 3037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.526488 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.526493 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.526532 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.529736 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.530306 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.530312 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.530316 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.530462 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.530780 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.530785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.530789 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.531170 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.531330 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.531637 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.531868 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 18:59:29.533294 5998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:29.534344 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.533909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60882)
0809 18:59:29.534092 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.534184 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 18:59:29.535311 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.534914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60892)
0809 18:59:29.535059 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.535168 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 18:59:29.535523 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
I20260809 18:59:29.575771 6113 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 3
I20260809 18:59:29.576798 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.576372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60896)
0809 18:59:29.576550 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.576639 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 18:59:29.577916 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.577513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60902)
0809 18:59:29.577721 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.577806 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260809 18:59:29.578115 6113 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
I20260809 18:59:29.586753 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 1
I20260809 18:59:29.587826 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.587352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60904)
0809 18:59:29.587550 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.587648 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 18:59:29.588897 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.588509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60906)
0809 18:59:29.588658 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.588756 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 18:59:29.589164 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
I20260809 18:59:29.657398 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 2
I20260809 18:59:29.658610 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.658023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60912)
0809 18:59:29.658286 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.658398 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 18:59:29.659601 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.659229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60916)
0809 18:59:29.659373 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.659458 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 18:59:29.659795 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
W20260809 18:59:29.702358 6127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:29.702634 6127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:29.702761 6127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:29.709649 6127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:29.709745 6127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:29.709816 6127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:29.709888 6127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:29.709944 6127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:29.719336 6127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:38459,127.16.188.253:38131,127.16.188.252:38937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab
--principal=kudu/127.16.188.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.252:38937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.188.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:29.720558 6127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:29.721306 6113 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 4
I20260809 18:59:29.722013 6127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:59:29.722438 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.721951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60922)
0809 18:59:29.722184 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.722281 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 18:59:29.723337 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.723043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:60938)
0809 18:59:29.723162 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.723226 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 18:59:29.723534 6113 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
W20260809 18:59:29.733035 6136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:29.733186 6138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:29.733193 6135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:29.734153 6127 server_base.cc:1034] running on GCE node
I20260809 18:59:29.734885 6127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:29.736116 6127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:29.737298 6127 hybrid_clock.cc:648] HybridClock initialized: now 1786301969737241 us; error 49 us; skew 500 ppm
I20260809 18:59:29.737615 6127 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301969, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:29.740433 6127 init.cc:377] Logged in from keytab as kudu/127.16.188.252@KRBTEST.COM (short username kudu)
I20260809 18:59:29.741837 6127 webserver.cc:460] Webserver started at http://127.16.188.252:44741/ using document root <none> and password file <none>
I20260809 18:59:29.742443 6127 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:29.742556 6127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:29.742842 6127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:29.745683 6127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/data/instance:
uuid: "e7cb725c4e554157a2ff2ba64f83149b"
format_stamp: "Formatted at 2026-08-09 18:59:29 on dist-test-slave-266d"
server_key: "f2a6e3f727eae213e7aa7c8b905546bc"
server_key_iv: "2383c77745b55880a9920eec429a708f"
server_key_version: "encryptionkey@0"
I20260809 18:59:29.746443 6127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/wal/instance:
uuid: "e7cb725c4e554157a2ff2ba64f83149b"
format_stamp: "Formatted at 2026-08-09 18:59:29 on dist-test-slave-266d"
server_key: "f2a6e3f727eae213e7aa7c8b905546bc"
server_key_iv: "2383c77745b55880a9920eec429a708f"
server_key_version: "encryptionkey@0"
I20260809 18:59:29.751183 6127 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 18:59:29.754346 6155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:29.755466 6127 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:59:29.755620 6127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/wal
uuid: "e7cb725c4e554157a2ff2ba64f83149b"
format_stamp: "Formatted at 2026-08-09 18:59:29 on dist-test-slave-266d"
server_key: "f2a6e3f727eae213e7aa7c8b905546bc"
server_key_iv: "2383c77745b55880a9920eec429a708f"
server_key_version: "encryptionkey@0"
I20260809 18:59:29.755782 6127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:29.765983 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 3
I20260809 18:59:29.766983 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.766532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:42140)
0809 18:59:29.766710 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.766805 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 18:59:29.767881 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.767531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:42144)
0809 18:59:29.767680 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.767764 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 18:59:29.768056 5998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:38937: Network error: Client connection negotiation failed: client connection to 127.16.188.252:38937: connect: Connection refused (error 111)
I20260809 18:59:29.782006 6127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:29.785601 6127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:29.785840 6127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:29.802425 6127 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.252:38937
I20260809 18:59:29.802455 6239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.252:38937 every 8 connection(s)
I20260809 18:59:29.803771 6127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
I20260809 18:59:29.807258 6240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:29.809614 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 6127
I20260809 18:59:29.809811 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301765673554-17139-0/minicluster-data/master-2/wal/instance
I20260809 18:59:29.810400 17139 external_mini_cluster.cc:1428] Setting key d88cc9dd0dc0c839cd8056a1ba7f6c96
I20260809 18:59:29.814855 6240 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301969, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
I20260809 18:59:29.832547 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.817565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52938 (local address 127.16.188.254:38459)
0809 18:59:29.817741 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.817747 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.818526 (+ 779us) server_negotiation.cc:407] Connection header received
0809 18:59:29.818793 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.818799 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.818877 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.818969 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.820049 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.820948 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.822810 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.823366 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.823480 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.826698 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.826705 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.826710 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.826752 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.829433 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.830167 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.830174 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.830177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.830341 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.830703 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.830708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.830711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.831018 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.831146 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.831967 (+ 821us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.832207 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 18:59:29.833630 6247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.817654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:38459 (local address 127.0.0.1:52938)
0809 18:59:29.818398 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.818445 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:29.818647 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:29.819027 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:29.819034 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:29.819652 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:29.819906 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.819915 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.821150 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.821154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.822682 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.822692 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.823589 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.823597 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.823747 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.824270 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:29.824291 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:29.826483 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:29.829557 (+ 3074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.829567 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.829578 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.830042 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.830440 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.830445 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.830448 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.830602 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.831132 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:29.831140 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:29.831571 (+ 431us) client_negotiation.cc:769] Sending connection context
0809 18:59:29.831854 (+ 283us) client_negotiation.cc:240] Negotiation successful
0809 18:59:29.832299 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"mutex_wait_us":37,"thread_start_us":358,"threads_started":1}
I20260809 18:59:29.833601 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.812269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42146 (local address 127.16.188.252:38937)
0809 18:59:29.813047 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.813059 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.813127 (+ 68us) server_negotiation.cc:407] Connection header received
0809 18:59:29.814747 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.814769 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.815150 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.815454 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.817260 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.819140 (+ 1880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.821272 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.822256 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.822418 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.827131 (+ 4713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.827140 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.827151 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.827179 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.829680 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.830373 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.830379 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.830381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.830563 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.830960 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.830964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.830966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.831566 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.831843 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.832139 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.832397 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":80,"server-negotiator.queue_time_us":572,"thread_start_us":346,"threads_started":1}
I20260809 18:59:29.835141 6240 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301969, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:29.849759 6247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.835768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:38131 (local address 127.0.0.1:42034)
0809 18:59:29.835900 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.835914 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:29.835984 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:29.836448 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:29.836452 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:29.836867 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:29.837003 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.837010 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.837967 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.837972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.839300 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.839314 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.840341 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.840350 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.840645 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.841350 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:29.841404 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:29.843791 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:29.847414 (+ 3623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.847420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.847423 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.847897 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.848242 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.848247 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.848251 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.848390 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.848862 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:29.848866 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:29.849004 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 18:59:29.849163 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 18:59:29.849428 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 18:59:29.849823 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.835986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42034 (local address 127.16.188.253:38131)
0809 18:59:29.836171 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.836176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.836194 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:59:29.836245 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.836249 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.836325 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.836411 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.837171 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.837821 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.839456 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.840144 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.840275 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.843992 (+ 3717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.843998 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.844003 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.844041 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.847293 (+ 3252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.847998 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.848001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.848004 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.848133 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.848490 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.848496 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.848499 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.848743 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.848880 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.849253 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.849448 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 18:59:29.850816 6240 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:59:29.851919 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.836699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52954 (local address 127.16.188.254:38459)
0809 18:59:29.836867 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.836872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.836890 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:59:29.837007 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.837013 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.837072 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.837187 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.838353 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.839681 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.841468 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.842044 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.842157 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.846660 (+ 4503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.846666 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.846671 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.846702 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.849329 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.849954 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.849959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.849962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.850106 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.850534 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.850540 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.850543 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.850869 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.851142 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.851431 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.851633 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301969, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 18:59:29.863621 6247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.851387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:42156)
0809 18:59:29.851630 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.851647 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:29.851732 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:29.852210 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:29.852213 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:29.852503 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:29.852618 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.852626 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.853716 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.853721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.854544 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.854555 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.855210 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.855215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.855406 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.855928 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:29.855949 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:29.858362 (+ 2413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:29.861259 (+ 2897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.861263 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.861265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.861629 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.861999 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.862002 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.862004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.862119 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.862620 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:29.862625 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:29.862790 (+ 165us) client_negotiation.cc:769] Sending connection context
0809 18:59:29.862932 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 18:59:29.863220 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260809 18:59:29.863582 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.851546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42156 (local address 127.16.188.252:38937)
0809 18:59:29.851666 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.851671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.851686 (+ 15us) server_negotiation.cc:407] Connection header received
0809 18:59:29.851950 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.851953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.852003 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.852073 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.852731 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.853605 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.854665 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.855088 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.855188 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.858520 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.858525 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.858530 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.858562 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.861139 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.861741 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.861747 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.861750 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.861898 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.862220 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.862225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.862228 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.862486 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.862595 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.863035 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.863350 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":125,"server-negotiator.queue_time_us":47}
I20260809 18:59:29.867686 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.853403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42038 (local address 127.16.188.253:38131)
0809 18:59:29.853548 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.853553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.853630 (+ 77us) server_negotiation.cc:407] Connection header received
0809 18:59:29.853744 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.853749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.853810 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.853882 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.854990 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.855680 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.857414 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.858061 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.858185 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.862290 (+ 4105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.862295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.862298 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.862325 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.865352 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.866107 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.866111 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.866113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.866233 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.866575 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.866577 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.866579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.866821 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.867022 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.867292 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.867450 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 18:59:29.869566 6240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b: Bootstrap starting.
I20260809 18:59:29.872352 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:59:29.873502 6240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:29.874775 6240 log.cc:824] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:29.877969 6240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b: No bootstrap required, opened a new log
I20260809 18:59:29.888628 6240 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:29.889074 6240 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:29.889240 6240 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7cb725c4e554157a2ff2ba64f83149b, State: Initialized, Role: FOLLOWER
I20260809 18:59:29.889942 6240 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:29.896832 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.878076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42048 (local address 127.16.188.253:38131)
0809 18:59:29.878403 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.878409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.879432 (+ 1023us) server_negotiation.cc:407] Connection header received
0809 18:59:29.879814 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.879839 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.879912 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.879979 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.882203 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.883180 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.885156 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.885739 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.885821 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.889729 (+ 3908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.889736 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.889741 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.889779 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.893288 (+ 3509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.894372 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.894378 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.894382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.894548 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.895045 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.895050 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.895054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.895414 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.895594 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.896232 (+ 638us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.896477 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220}
I20260809 18:59:29.896832 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.877913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52970 (local address 127.16.188.254:38459)
0809 18:59:29.878269 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.878277 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.878982 (+ 705us) server_negotiation.cc:407] Connection header received
0809 18:59:29.879253 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.879259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.879338 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.879409 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.881774 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.882846 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.884971 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.885617 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.885712 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.889729 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.889736 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.889741 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.889798 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.893253 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.894372 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.894378 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.894382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.894553 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.895045 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.895050 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.895054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.895375 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.895591 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.896232 (+ 641us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.896477 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222}
I20260809 18:59:29.898437 6240 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:29.900027 6263 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:29.900429 6263 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:29.902730 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.879342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42170 (local address 127.16.188.252:38937)
0809 18:59:29.879576 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.879582 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.885875 (+ 6293us) server_negotiation.cc:407] Connection header received
0809 18:59:29.886294 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.886299 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.886372 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.886435 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.888624 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.889700 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.891605 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.892330 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.892422 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.896176 (+ 3754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.896183 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.896189 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.896228 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.899838 (+ 3610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.900662 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.900666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.900668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.900828 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.901209 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.901215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.901218 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.901615 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.901912 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.902148 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.902376 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
W20260809 18:59:29.908929 6288 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:59:29.909039 6288 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:59:29.906952 6127 master_runner.cc:186] Error getting master registration for 127.16.188.254:38459: OK, instance_id { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" instance_seqno: 1786301968812463 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:59:29.915372 6127 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:59:29.917994 6263 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:29.918320 6263 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:29.920275 6263 leader_election.cc:288] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29abfd9316354ec4a61f620acd559ba2 (127.16.188.254:38459), f5df804a78f9499aa89e1fc491940a58 (127.16.188.253:38131)
I20260809 18:59:29.945286 5998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 4
Aug 09 18:59:29 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301968, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
I20260809 18:59:29.962427 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.946054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:42180)
0809 18:59:29.946245 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:29.946265 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:29.946365 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:29.946689 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:29.946695 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:29.947199 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:29.947419 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.947431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.948873 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.948879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.950384 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:29.950399 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.951400 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.951406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:29.951598 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.952199 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:29.952221 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:29.955718 (+ 3497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:29.959670 (+ 3952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.959676 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.959680 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.960200 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.960653 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:29.960657 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:29.960661 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:29.960826 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:29.961462 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:29.961467 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:29.961622 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 18:59:29.961772 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 18:59:29.962031 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 18:59:29.962752 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:29.946218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42180 (local address 127.16.188.252:38937)
0809 18:59:29.946397 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:29.946403 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:29.946421 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:59:29.946470 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:29.946475 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:29.946563 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:29.946656 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:29.947567 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.948754 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.950536 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:29.951244 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:29.951379 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:29.955879 (+ 4500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:29.955886 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:29.955895 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:29.955934 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:29.959544 (+ 3610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.960311 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.960316 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.960320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.960530 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:29.960929 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:29.960955 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:29.960959 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:29.961337 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:29.961481 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:29.961888 (+ 407us) server_negotiation.cc:299] Negotiation successful
0809 18:59:29.962129 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 18:59:29.968766 5998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2: Bootstrap starting.
I20260809 18:59:29.972919 5998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:29.974251 5998 log.cc:824] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:29.977591 5998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2: No bootstrap required, opened a new log
I20260809 18:59:29.988498 5998 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:29.988889 5998 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:29.989156 5998 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29abfd9316354ec4a61f620acd559ba2, State: Initialized, Role: FOLLOWER
I20260809 18:59:29.989833 5998 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:29.990916 6294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:29.991468 6294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:29.992123 5998 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:29.992218 5962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7cb725c4e554157a2ff2ba64f83149b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29abfd9316354ec4a61f620acd559ba2" is_pre_election: true
I20260809 18:59:29.992795 5962 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7cb725c4e554157a2ff2ba64f83149b in term 0.
I20260809 18:59:29.993578 6157 leader_election.cc:302] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29abfd9316354ec4a61f620acd559ba2, e7cb725c4e554157a2ff2ba64f83149b; no voters:
I20260809 18:59:29.994065 6263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:29.994230 6263 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:29.994345 6263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:29.997685 6263 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:29.998953 5962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7cb725c4e554157a2ff2ba64f83149b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29abfd9316354ec4a61f620acd559ba2"
I20260809 18:59:29.999078 6263 leader_election.cc:288] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [CANDIDATE]: Term 1 election: Requested vote from peers 29abfd9316354ec4a61f620acd559ba2 (127.16.188.254:38459), f5df804a78f9499aa89e1fc491940a58 (127.16.188.253:38131)
I20260809 18:59:29.999271 5962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:30.002799 5962 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7cb725c4e554157a2ff2ba64f83149b in term 1.
I20260809 18:59:30.003305 6157 leader_election.cc:302] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29abfd9316354ec4a61f620acd559ba2, e7cb725c4e554157a2ff2ba64f83149b; no voters:
I20260809 18:59:30.003646 6263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:30.004194 6263 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [term 1 LEADER]: Becoming Leader. State: Replica: e7cb725c4e554157a2ff2ba64f83149b, State: Running, Role: LEADER
I20260809 18:59:30.004741 6263 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:30.008018 6303 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7cb725c4e554157a2ff2ba64f83149b. Latest consensus state: current_term: 1 leader_uuid: "e7cb725c4e554157a2ff2ba64f83149b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:30.008467 6303 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:30.009752 6308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:30.015501 6308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:30.022718 6113 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } attempt: 5
I20260809 18:59:30.033793 5962 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [term 1 FOLLOWER]: Refusing update from remote peer e7cb725c4e554157a2ff2ba64f83149b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:30.035036 6303 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 09 18:59:30 dist-test-slave-266d krb5kdc[5873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301969, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
W20260809 18:59:30.040345 6162 tablet.cc:2369] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:30.040632 6320 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:59:30.050868 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:30.023344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:38937 (local address 127.0.0.1:42188)
0809 18:59:30.023516 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:30.023537 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:30.023660 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:30.024167 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:30.024173 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:30.024793 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:30.025042 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:30.025058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:30.026836 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:30.026844 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:30.028231 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:30.028251 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:30.029670 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:30.029677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:30.029900 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:30.035180 (+ 5280us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:30.035240 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:30.040431 (+ 5191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:30.046997 (+ 6566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:30.047004 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:30.047009 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:30.047576 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:30.048134 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:30.048140 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:30.048144 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:30.048603 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:30.049629 (+ 1026us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:30.049635 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:30.049838 (+ 203us) client_negotiation.cc:769] Sending connection context
0809 18:59:30.050019 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 18:59:30.050353 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 18:59:30.051923 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:30.023685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42188 (local address 127.16.188.252:38937)
0809 18:59:30.023857 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:30.023863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:30.023882 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:59:30.023937 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:30.023942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:30.024013 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:30.024126 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:30.025289 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:30.026571 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:30.028470 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:30.029249 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:30.029378 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:30.040947 (+ 11569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:30.040956 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:30.040961 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:30.041005 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:30.046809 (+ 5804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:30.047765 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:30.047777 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:30.047782 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:30.047957 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:30.048789 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:30.048796 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:30.048800 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:30.049260 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:30.049496 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:30.050317 (+ 821us) server_negotiation.cc:299] Negotiation successful
0809 18:59:30.050871 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 18:59:30.053133 5929 tablet.cc:2369] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:30.054523 6294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7cb725c4e554157a2ff2ba64f83149b. Latest consensus state: current_term: 1 leader_uuid: "e7cb725c4e554157a2ff2ba64f83149b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:30.054836 6294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:30.059569 6113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58: Bootstrap starting.
I20260809 18:59:30.063813 6113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:30.065196 6113 log.cc:824] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:30.068904 6113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58: No bootstrap required, opened a new log
I20260809 18:59:30.074724 6322 mvcc.cc:205] Tried to move back new op lower bound from 7316692869240082432 to 7316692869144371200. Current Snapshot: MvccSnapshot[applied={T|T < 7316692869240082432}]
I20260809 18:59:30.079922 6113 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:30.080437 6113 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:30.080595 6113 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df804a78f9499aa89e1fc491940a58, State: Initialized, Role: FOLLOWER
I20260809 18:59:30.081288 6113 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } }
I20260809 18:59:30.082758 6294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e7cb725c4e554157a2ff2ba64f83149b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:30.083024 6294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:30.068745 5894 master_runner.cc:186] Error getting master registration for 127.16.188.253:38131: OK, instance_id { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" instance_seqno: 1786301969304810 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:59:30.086062 5894 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:59:30.087229 6263 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e7cb725c4e554157a2ff2ba64f83149b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:30.087599 6263 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:30.089658 6308 catalog_manager.cc:1347] Generated new cluster ID: af82aad78bbc4d0d9bbcd61a107adf1e
I20260809 18:59:30.089763 6308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:30.093611 6330 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:30.094036 6330 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:30.094937 6113 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:30.095369 6071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:30.098376 6072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7cb725c4e554157a2ff2ba64f83149b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5df804a78f9499aa89e1fc491940a58"
I20260809 18:59:30.099186 6073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7cb725c4e554157a2ff2ba64f83149b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5df804a78f9499aa89e1fc491940a58" is_pre_election: true
I20260809 18:59:30.100579 6071 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [term 1 FOLLOWER]: Refusing update from remote peer e7cb725c4e554157a2ff2ba64f83149b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:30.101364 6303 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:30.150683 6308 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:30.152662 6308 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:30.158273 6263 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e7cb725c4e554157a2ff2ba64f83149b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:30.158562 6263 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:30.158389 6330 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7cb725c4e554157a2ff2ba64f83149b. Latest consensus state: current_term: 1 leader_uuid: "e7cb725c4e554157a2ff2ba64f83149b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:30.158720 6330 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:30.159490 6345 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e7cb725c4e554157a2ff2ba64f83149b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29abfd9316354ec4a61f620acd559ba2" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38459 } } peers { permanent_uuid: "f5df804a78f9499aa89e1fc491940a58" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 38131 } } peers { permanent_uuid: "e7cb725c4e554157a2ff2ba64f83149b" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 38937 } } }
I20260809 18:59:30.159890 6345 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:59:30.166139 6308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7cb725c4e554157a2ff2ba64f83149b: Generated new TSK 0
I20260809 18:59:30.168134 6308 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:59:30.196635 6355 catalog_manager.cc:1259] Loaded cluster ID: af82aad78bbc4d0d9bbcd61a107adf1e
I20260809 18:59:30.196763 6355 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58: loading cluster ID for follower catalog manager: success
I20260809 18:59:30.200548 6355 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58: acquiring CA information for follower catalog manager: success
I20260809 18:59:30.203075 6355 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f5df804a78f9499aa89e1fc491940a58: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:59:31.045279 6320 catalog_manager.cc:1259] Loaded cluster ID: af82aad78bbc4d0d9bbcd61a107adf1e
I20260809 18:59:31.045387 6320 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2: loading cluster ID for follower catalog manager: success
I20260809 18:59:31.048046 6320 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2: acquiring CA information for follower catalog manager: success
I20260809 18:59:31.049930 6320 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 29abfd9316354ec4a61f620acd559ba2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:59:31.268018 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 5894
I20260809 18:59:31.269838 5990 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:31.378850 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 5894
I20260809 18:59:31.403286 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 6007
I20260809 18:59:31.404316 6108 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:31.509523 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 6007
I20260809 18:59:31.536410 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 6127
I20260809 18:59:31.537600 6234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:31.642773 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 6127
2026-08-09T18:59:31Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4724 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:59:31 dist-test-slave-266d krb5kdc[6376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:59:31 dist-test-slave-266d krb5kdc[6376](info): set up 2 sockets
Aug 09 18:59:31 dist-test-slave-266d krb5kdc[6376](info): commencing operation
krb5kdc: starting...
W20260809 18:59:32.867610 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:59:33 dist-test-slave-266d krb5kdc[6376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:59:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:59:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:59:33.118240 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:39255
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:37995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:39255
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:33.445457 6396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:33.445716 6396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:33.445811 6396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:33.452685 6396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:33.452782 6396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:33.452836 6396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:33.452890 6396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:33.452932 6396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:33.462275 6396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:39255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:39255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:33.463445 6396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:33.464620 6396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:33.475713 6408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.475659 6412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:33.475622 6410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:33.476735 6396 server_base.cc:1034] running on GCE node
I20260809 18:59:33.477509 6396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:33.478848 6396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:33.480050 6396 hybrid_clock.cc:648] HybridClock initialized: now 1786301973479996 us; error 47 us; skew 500 ppm
I20260809 18:59:33.480379 6396 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:33 dist-test-slave-266d krb5kdc[6376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:33.483331 6396 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:59:33.484738 6396 webserver.cc:460] Webserver started at http://127.16.188.254:38885/ using document root <none> and password file <none>
I20260809 18:59:33.485420 6396 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:33.485543 6396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:33.485836 6396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:33.488667 6396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-266d"
server_key: "0d54ad4f6247069e4aee08924adcd9a4"
server_key_iv: "1e768497087d49342feae6a6b477b174"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.489429 6396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-266d"
server_key: "0d54ad4f6247069e4aee08924adcd9a4"
server_key_iv: "1e768497087d49342feae6a6b477b174"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.494448 6396 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 18:59:33.497737 6422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:33.498958 6396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 18:59:33.499126 6396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41"
format_stamp: "Formatted at 2026-08-09 18:59:33 on dist-test-slave-266d"
server_key: "0d54ad4f6247069e4aee08924adcd9a4"
server_key_iv: "1e768497087d49342feae6a6b477b174"
server_key_version: "encryptionkey@0"
I20260809 18:59:33.499305 6396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:33.522845 6396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:33.526688 6396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:33.526945 6396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:33.544072 6396 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:39255
I20260809 18:59:33.544093 6502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:39255 every 8 connection(s)
I20260809 18:59:33.545389 6396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:33.549047 6506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:33.551652 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 6396
I20260809 18:59:33.551853 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:59:33.552482 17139 external_mini_cluster.cc:1428] Setting key 277e8765486d2cb460c422b860f6f38e
I20260809 18:59:33.560622 6506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41: Bootstrap starting.
I20260809 18:59:33.564324 6506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:33.565629 6506 log.cc:824] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41: Log is configured to *not* fsync() on all Append() calls
Aug 09 18:59:33 dist-test-slave-266d krb5kdc[6376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:33.568567 6506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41: No bootstrap required, opened a new log
I20260809 18:59:33.575243 6509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:33.554234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.16.188.254:39255)
0809 18:59:33.554979 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:33.554990 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:33.555031 (+ 41us) server_negotiation.cc:407] Connection header received
0809 18:59:33.556708 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:33.556730 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:33.557143 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:33.557483 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:33.559264 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.560505 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.562395 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:33.563041 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:33.563163 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:33.568047 (+ 4884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:33.568054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:33.568068 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:33.568108 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:33.571171 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:33.572003 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:33.572009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:33.572015 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:33.572183 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:33.572575 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:33.572578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:33.572580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:33.573161 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:33.573403 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:33.573848 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 18:59:33.574195 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":353,"threads_started":1}
I20260809 18:59:33.577765 6506 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39255 } }
I20260809 18:59:33.578186 6506 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:33.578298 6506 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a822a0ab9b4d6b91b2e8db51c7aa41, State: Initialized, Role: FOLLOWER
I20260809 18:59:33.578815 6506 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39255 } }
I20260809 18:59:33.579064 6506 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:33.579155 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:59:33.579203 6506 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:33.579365 6506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:33.581559 6506 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39255 } }
I20260809 18:59:33.582029 6506 leader_election.cc:302] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4a822a0ab9b4d6b91b2e8db51c7aa41; no voters:
I20260809 18:59:33.582571 6506 leader_election.cc:288] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:59:33.582686 6512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:33.583307 6512 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [term 1 LEADER]: Becoming Leader. State: Replica: b4a822a0ab9b4d6b91b2e8db51c7aa41, State: Running, Role: LEADER
I20260809 18:59:33.583818 6512 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39255 } }
I20260809 18:59:33.584604 6506 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:33.586894 6514 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4a822a0ab9b4d6b91b2e8db51c7aa41. Latest consensus state: current_term: 1 leader_uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39255 } } }
I20260809 18:59:33.586907 6513 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a822a0ab9b4d6b91b2e8db51c7aa41" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 39255 } } }
I20260809 18:59:33.587337 6513 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:33.587337 6514 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41 [sys.catalog]: This master's current role is: LEADER
W20260809 18:59:33.594954 6542 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:59:33.595060 6542 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:59:33.595191 6523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:33.596823 6523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:33.604143 6523 catalog_manager.cc:1347] Generated new cluster ID: 4e01a9adccf64a3d8e8e8fcd9032ffc3
I20260809 18:59:33.604244 6523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:33.622318 6523 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:33.624123 6523 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:33.634817 6523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4a822a0ab9b4d6b91b2e8db51c7aa41: Generated new TSK 0
I20260809 18:59:33.635805 6523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:59:33.694568 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 6396
I20260809 18:59:33.695742 6497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:33.790060 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 6396
2026-08-09T18:59:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2147 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:59:33 dist-test-slave-266d krb5kdc[6552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:59:33 dist-test-slave-266d krb5kdc[6552](info): set up 2 sockets
Aug 09 18:59:33 dist-test-slave-266d krb5kdc[6552](info): commencing operation
krb5kdc: starting...
W20260809 18:59:35.010073 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 18:59:35 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:59:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:59:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 18:59:35.288420 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40467
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:40467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:35.632365 6577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:35.632663 6577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:35.632771 6577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:35.640044 6577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:35.640156 6577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:35.640216 6577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:35.640290 6577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:35.640339 6577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:35.650130 6577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:40467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:35.651336 6577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:35.652630 6577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:35.664223 6588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:35.664285 6590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:35.664371 6592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:35.665707 6577 server_base.cc:1034] running on GCE node
I20260809 18:59:35.666510 6577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:35.667939 6577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:35.669178 6577 hybrid_clock.cc:648] HybridClock initialized: now 1786301975669119 us; error 37 us; skew 500 ppm
I20260809 18:59:35.669523 6577 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:35 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301975, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:35.675758 6577 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:59:35.677356 6577 webserver.cc:460] Webserver started at http://127.16.188.254:39473/ using document root <none> and password file <none>
I20260809 18:59:35.678066 6577 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:35.678206 6577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:35.678519 6577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:35.681710 6577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "5265e67decf54a9b9449e1fab8894375"
format_stamp: "Formatted at 2026-08-09 18:59:35 on dist-test-slave-266d"
server_key: "2e65e3fc82444e640047edd011d98ef6"
server_key_iv: "684fc4a2a9989f40abcdf03478387801"
server_key_version: "encryptionkey@0"
I20260809 18:59:35.682500 6577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "5265e67decf54a9b9449e1fab8894375"
format_stamp: "Formatted at 2026-08-09 18:59:35 on dist-test-slave-266d"
server_key: "2e65e3fc82444e640047edd011d98ef6"
server_key_iv: "684fc4a2a9989f40abcdf03478387801"
server_key_version: "encryptionkey@0"
I20260809 18:59:35.687665 6577 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 18:59:35.691171 6601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:35.692421 6577 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:35.692585 6577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "5265e67decf54a9b9449e1fab8894375"
format_stamp: "Formatted at 2026-08-09 18:59:35 on dist-test-slave-266d"
server_key: "2e65e3fc82444e640047edd011d98ef6"
server_key_iv: "684fc4a2a9989f40abcdf03478387801"
server_key_version: "encryptionkey@0"
I20260809 18:59:35.692797 6577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:35.717242 6577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:35.720953 6577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:35.721246 6577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:35.738684 6577 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:40467
I20260809 18:59:35.738713 6678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:40467 every 8 connection(s)
I20260809 18:59:35.739990 6577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:35.742405 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 6577
I20260809 18:59:35.742595 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 18:59:35.743227 17139 external_mini_cluster.cc:1428] Setting key 044fc9d6a86e644e2a6dc7fa3bf3a4dc
I20260809 18:59:35.743690 6681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:35.757251 6681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Bootstrap starting.
Aug 09 18:59:35 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:35.760318 6681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:35.761435 6681 log.cc:824] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:35.764016 6681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: No bootstrap required, opened a new log
I20260809 18:59:35.765794 6685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:35.745015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46798 (local address 127.16.188.254:40467)
0809 18:59:35.745811 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:35.745821 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:35.745862 (+ 41us) server_negotiation.cc:407] Connection header received
0809 18:59:35.748081 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:35.748102 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:35.748447 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:35.748776 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:35.750494 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:35.751760 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:35.753577 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:35.754270 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:35.754406 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:35.758956 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:35.758963 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:35.758976 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:35.759011 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:35.761923 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:35.762576 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:35.762583 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:35.762588 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:35.762761 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:35.763131 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:35.763135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:35.763137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:35.763646 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:35.763934 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:35.764382 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 18:59:35.764785 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":321,"threads_started":1}
I20260809 18:59:35.771584 6681 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:35.772022 6681 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:35.772140 6681 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5265e67decf54a9b9449e1fab8894375, State: Initialized, Role: FOLLOWER
I20260809 18:59:35.772732 6681 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:35.772961 6681 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:35.773108 6681 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:35.773298 6681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:35.775417 6681 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:35.775905 6681 leader_election.cc:302] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5265e67decf54a9b9449e1fab8894375; no voters:
I20260809 18:59:35.776513 6681 leader_election.cc:288] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:59:35.776685 6690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:35.777705 6690 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 1 LEADER]: Becoming Leader. State: Replica: 5265e67decf54a9b9449e1fab8894375, State: Running, Role: LEADER
I20260809 18:59:35.778348 6690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:35.778825 6681 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:35.781612 6694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5265e67decf54a9b9449e1fab8894375. Latest consensus state: current_term: 1 leader_uuid: "5265e67decf54a9b9449e1fab8894375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } } }
I20260809 18:59:35.782007 6694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:35.782497 6693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5265e67decf54a9b9449e1fab8894375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } } }
I20260809 18:59:35.783363 6693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:35.791942 6705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:35.796476 6705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:35.804296 6705 catalog_manager.cc:1347] Generated new cluster ID: e61b64365d624fd5b6d003904a42a7e6
I20260809 18:59:35.804400 6705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:35.813270 6705 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:59:35.814445 6705 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:35.823576 6705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Generated new TSK 0
I20260809 18:59:35.824313 6705 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 18:59:35.886446 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40467
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:36.208690 6726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:36.208936 6726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:36.209028 6726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:36.215893 6726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:36.215981 6726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:36.216084 6726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:59:36.225332 6726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:36.226394 6726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:36.227551 6726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:36.239790 6734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:36.239701 6735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:36.239756 6738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:36.240518 6726 server_base.cc:1034] running on GCE node
I20260809 18:59:36.241122 6726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:36.241968 6726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:36.243165 6726 hybrid_clock.cc:648] HybridClock initialized: now 1786301976243118 us; error 39 us; skew 500 ppm
I20260809 18:59:36.243445 6726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:36 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301976, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:36.246388 6726 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:59:36.247733 6726 webserver.cc:460] Webserver started at http://127.16.188.193:43243/ using document root <none> and password file <none>
I20260809 18:59:36.248347 6726 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:36.248462 6726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:36.248737 6726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:36.251437 6726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "188ca871512f4ee2895c3b16ed2af686"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "56d301c61bf43e56c630769e0e8a6965"
server_key_iv: "6748705cc43846e52da831cacfbee805"
server_key_version: "encryptionkey@0"
I20260809 18:59:36.252177 6726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "188ca871512f4ee2895c3b16ed2af686"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "56d301c61bf43e56c630769e0e8a6965"
server_key_iv: "6748705cc43846e52da831cacfbee805"
server_key_version: "encryptionkey@0"
I20260809 18:59:36.256845 6726 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260809 18:59:36.260012 6749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:36.261297 6726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:59:36.261441 6726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "188ca871512f4ee2895c3b16ed2af686"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "56d301c61bf43e56c630769e0e8a6965"
server_key_iv: "6748705cc43846e52da831cacfbee805"
server_key_version: "encryptionkey@0"
I20260809 18:59:36.261611 6726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:36.282461 6726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:36.286018 6726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:36.286267 6726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:36.287153 6726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:36.288394 6726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:36.288468 6726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:36.288584 6726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:36.288645 6726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:36.317863 6726 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:36011
I20260809 18:59:36.317911 6930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:36011 every 8 connection(s)
I20260809 18:59:36.319056 6726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:36.320397 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 6726
I20260809 18:59:36.320611 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 18:59:36.321341 17139 external_mini_cluster.cc:1428] Setting key 7cf92bec31de147cec1a5cb424a0434f
Aug 09 18:59:36 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301976, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:36.340536 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:36.321469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:52095 (local address 127.16.188.254:40467)
0809 18:59:36.321933 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:36.321941 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:36.323563 (+ 1622us) server_negotiation.cc:407] Connection header received
0809 18:59:36.325950 (+ 2387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:36.325954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:36.326019 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:36.326107 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:36.327876 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:36.328727 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:36.330850 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:36.331249 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:36.331345 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:36.335139 (+ 3794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:36.335144 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:36.335147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:36.335179 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:36.337702 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:36.338379 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:36.338383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:36.338385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:36.338505 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:36.338903 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:36.338907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:36.338909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:36.339164 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:36.339298 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:36.339965 (+ 667us) server_negotiation.cc:299] Negotiation successful
0809 18:59:36.340186 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":206,"threads_started":1}
I20260809 18:59:36.341470 6935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:36.321993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:52095)
0809 18:59:36.323390 (+ 1397us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:36.323451 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:36.325679 (+ 2228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:36.326360 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:36.326371 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:36.327017 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:36.327731 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:36.327754 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:36.328912 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:36.328918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:36.330691 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:36.330708 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:36.331466 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:36.331472 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:36.331734 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:36.332376 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:36.332409 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:36.334909 (+ 2500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:36.337845 (+ 2936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:36.337851 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:36.337862 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:36.338255 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:36.338608 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:36.338613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:36.338615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:36.338790 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:36.339287 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:36.339294 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:36.339597 (+ 303us) client_negotiation.cc:769] Sending connection context
0809 18:59:36.339824 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 18:59:36.340316 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"thread_start_us":308,"threads_started":1}
I20260809 18:59:36.342952 6931 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40467
I20260809 18:59:36.343230 6931 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:36.343927 6931 heartbeater.cc:511] Master 127.16.188.254:40467 requested a full tablet report, sending...
I20260809 18:59:36.345947 6627 ts_manager.cc:194] Registered new tserver with Master: 188ca871512f4ee2895c3b16ed2af686 (127.16.188.193:36011)
I20260809 18:59:36.347357 6627 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:52095
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 18:59:36.379886 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40467
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:36.701547 6939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:36.701810 6939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:36.701908 6939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:36.708751 6939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:36.708846 6939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:36.708961 6939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:59:36.718107 6939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:36.719229 6939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:36.720429 6939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:36.732635 6948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:36.732678 6949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:36.732713 6951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:36.733763 6939 server_base.cc:1034] running on GCE node
I20260809 18:59:36.734349 6939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:36.735209 6939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:36.736407 6939 hybrid_clock.cc:648] HybridClock initialized: now 1786301976736366 us; error 32 us; skew 500 ppm
I20260809 18:59:36.736708 6939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:36 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301976, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:36.739827 6939 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:59:36.741278 6939 webserver.cc:460] Webserver started at http://127.16.188.194:42119/ using document root <none> and password file <none>
I20260809 18:59:36.741986 6939 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:36.742102 6939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:36.742374 6939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:36.745118 6939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "df28bcd3fcba490c8859aa742e55ab00"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "5b80805db79da73c2810d49ac4881c65"
server_key_iv: "0a771bfc1280f734f5988ac0d6e4fd18"
server_key_version: "encryptionkey@0"
I20260809 18:59:36.745883 6939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "df28bcd3fcba490c8859aa742e55ab00"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "5b80805db79da73c2810d49ac4881c65"
server_key_iv: "0a771bfc1280f734f5988ac0d6e4fd18"
server_key_version: "encryptionkey@0"
I20260809 18:59:36.750767 6939 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260809 18:59:36.753998 6962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:36.755220 6939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 18:59:36.755370 6939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "df28bcd3fcba490c8859aa742e55ab00"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "5b80805db79da73c2810d49ac4881c65"
server_key_iv: "0a771bfc1280f734f5988ac0d6e4fd18"
server_key_version: "encryptionkey@0"
I20260809 18:59:36.755538 6939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:36.772812 6939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:36.776247 6939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:36.776501 6939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:36.777386 6939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:36.778604 6939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:36.778708 6939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:36.778806 6939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:36.778849 6939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:36.808604 6939 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:37827
I20260809 18:59:36.808629 7145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:37827 every 8 connection(s)
I20260809 18:59:36.809888 6939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:36.812798 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 6939
I20260809 18:59:36.813007 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 18:59:36.813656 17139 external_mini_cluster.cc:1428] Setting key 71aaaa779db78d16023afeb0eea2364f
Aug 09 18:59:36 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301976, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:36.829486 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:36.812277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:49375 (local address 127.16.188.254:40467)
0809 18:59:36.812454 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:36.812458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:36.813846 (+ 1388us) server_negotiation.cc:407] Connection header received
0809 18:59:36.816025 (+ 2179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:36.816031 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:36.816109 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:36.816192 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:36.817679 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:36.818406 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:36.819876 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:36.820275 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:36.820385 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:36.823967 (+ 3582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:36.823972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:36.823975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:36.824006 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:36.826595 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:36.827287 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:36.827292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:36.827295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:36.827447 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:36.827828 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:36.827832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:36.827835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:36.828168 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:36.828309 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:36.828915 (+ 606us) server_negotiation.cc:299] Negotiation successful
0809 18:59:36.829155 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 18:59:36.830300 7148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:36.812892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:49375)
0809 18:59:36.813693 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:36.813728 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:36.815764 (+ 2036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:36.816437 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:36.816444 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:36.816914 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:36.817524 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:36.817541 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:36.818551 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:36.818555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:36.819740 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:36.819752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:36.820512 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:36.820521 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:36.820717 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:36.821349 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:36.821377 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:36.823731 (+ 2354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:36.826741 (+ 3010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:36.826747 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:36.826758 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:36.827167 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:36.827548 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:36.827551 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:36.827553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:36.827724 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:36.828267 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:36.828272 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:36.828569 (+ 297us) client_negotiation.cc:769] Sending connection context
0809 18:59:36.828785 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 18:59:36.829205 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":347,"threads_started":1}
I20260809 18:59:36.831632 7146 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40467
I20260809 18:59:36.831948 7146 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:36.832861 7146 heartbeater.cc:511] Master 127.16.188.254:40467 requested a full tablet report, sending...
I20260809 18:59:36.834409 6627 ts_manager.cc:194] Registered new tserver with Master: df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827)
I20260809 18:59:36.835273 6627 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:49375
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 18:59:36.871560 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40467
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:37.188202 7151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:37.188489 7151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:37.188628 7151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:37.195643 7151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:37.195731 7151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:37.195848 7151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:59:37.205008 7151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:37.206110 7151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:37.207319 7151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:37.219282 7159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:37.219308 7162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:37.219336 7158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:37.220429 7151 server_base.cc:1034] running on GCE node
I20260809 18:59:37.220968 7151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:37.221841 7151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:37.223037 7151 hybrid_clock.cc:648] HybridClock initialized: now 1786301977222983 us; error 41 us; skew 500 ppm
I20260809 18:59:37.223317 7151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:37 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301977, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:37.226251 7151 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:59:37.227536 7151 webserver.cc:460] Webserver started at http://127.16.188.195:34545/ using document root <none> and password file <none>
I20260809 18:59:37.228170 7151 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:37.228286 7151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:37.228569 7151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:59:37.231333 7151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "a226797d4446412e8e6b6a1ea4d068c9"
format_stamp: "Formatted at 2026-08-09 18:59:37 on dist-test-slave-266d"
server_key: "a693ca3022c5ea18101400625de7ba36"
server_key_iv: "a5c418f1749f504851d8cd0c7853a964"
server_key_version: "encryptionkey@0"
I20260809 18:59:37.232088 7151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "a226797d4446412e8e6b6a1ea4d068c9"
format_stamp: "Formatted at 2026-08-09 18:59:37 on dist-test-slave-266d"
server_key: "a693ca3022c5ea18101400625de7ba36"
server_key_iv: "a5c418f1749f504851d8cd0c7853a964"
server_key_version: "encryptionkey@0"
I20260809 18:59:37.237030 7151 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 18:59:37.240197 7170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:37.241401 7151 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 18:59:37.241544 7151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "a226797d4446412e8e6b6a1ea4d068c9"
format_stamp: "Formatted at 2026-08-09 18:59:37 on dist-test-slave-266d"
server_key: "a693ca3022c5ea18101400625de7ba36"
server_key_iv: "a5c418f1749f504851d8cd0c7853a964"
server_key_version: "encryptionkey@0"
I20260809 18:59:37.241744 7151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:37.271785 7151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:37.276041 7151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:37.276321 7151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:37.277263 7151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:37.278556 7151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:37.278644 7151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:37.278769 7151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:37.278877 7151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 18:59:37.308409 7151 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:40205
I20260809 18:59:37.308444 7349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:40205 every 8 connection(s)
I20260809 18:59:37.309661 7151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:37.313230 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 7151
I20260809 18:59:37.313427 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 18:59:37.314046 17139 external_mini_cluster.cc:1428] Setting key 8cb9e01a08efc0323a3e2a4877cd901c
Aug 09 18:59:37 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301977, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:37.330097 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.312097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:47181 (local address 127.16.188.254:40467)
0809 18:59:37.312280 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.312285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.313524 (+ 1239us) server_negotiation.cc:407] Connection header received
0809 18:59:37.315746 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.315750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.315839 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.315930 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:37.317878 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.318645 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.320804 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.321303 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.321397 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.324815 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:37.324820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:37.324823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:37.324855 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:37.327241 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:37.327985 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:37.327990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:37.327993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:37.328152 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:37.328564 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:37.328568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:37.328571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:37.328875 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:37.329033 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.329693 (+ 660us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.329856 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 18:59:37.330932 7352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.312537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:47181)
0809 18:59:37.313357 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.313406 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:37.315453 (+ 2047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:37.316179 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:37.316191 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:37.316944 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:37.317711 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.317736 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.318792 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.318798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.320679 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.320694 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.321505 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.321514 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.321789 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.322451 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:37.322479 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:37.324635 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:37.327385 (+ 2750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:37.327391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:37.327401 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:37.327881 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:37.328278 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:37.328282 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:37.328285 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:37.328456 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:37.329004 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:37.329009 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:37.329372 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 18:59:37.329583 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 18:59:37.329928 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":288,"threads_started":1}
I20260809 18:59:37.332077 7350 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40467
I20260809 18:59:37.332335 7350 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:37.332963 7350 heartbeater.cc:511] Master 127.16.188.254:40467 requested a full tablet report, sending...
I20260809 18:59:37.334338 6627 ts_manager.cc:194] Registered new tserver with Master: a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205)
I20260809 18:59:37.335078 6627 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:47181
I20260809 18:59:37.341215 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:37.350366 6931 heartbeater.cc:503] Master 127.16.188.254:40467 was elected leader, sending a full tablet report...
I20260809 18:59:37.357239 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.345495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46810 (local address 127.16.188.254:40467)
0809 18:59:37.345707 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.345714 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.346095 (+ 381us) server_negotiation.cc:407] Connection header received
0809 18:59:37.346248 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.346253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.346318 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.346394 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:37.347617 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.348313 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.349612 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.350004 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.350093 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.352699 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:37.352703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:37.352707 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:37.352737 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:37.355104 (+ 2367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:37.355678 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:37.355681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:37.355683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:37.355801 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:37.356092 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:37.356095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:37.356097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:37.356409 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:37.356585 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.356826 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.356978 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:59:37.360932 6627 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46810:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:59:37.367692 6627 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:59:37.390482 7370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.379911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60690 (local address 127.16.188.194:37827)
0809 18:59:37.380560 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.380570 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.382352 (+ 1782us) server_negotiation.cc:407] Connection header received
0809 18:59:37.382700 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.382708 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.382961 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.383146 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:37.384000 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.385525 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.387923 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.389176 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.389339 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.389514 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.389883 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.390101 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":349,"threads_started":1}
I20260809 18:59:37.390662 7372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.382329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52120 (local address 127.16.188.193:36011)
0809 18:59:37.383219 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.383227 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.383254 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:59:37.383341 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.383347 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.383514 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.383671 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:37.384404 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.385880 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.388477 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.389649 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.389847 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.390057 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.390217 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.390371 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":575,"threads_started":1}
I20260809 18:59:37.390753 7371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.381657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52120)
0809 18:59:37.382542 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.382558 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:37.382667 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:37.383698 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:37.383703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:37.383731 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:37.384179 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.384191 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.386026 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.386031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.388359 (+ 2328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.388371 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.389865 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.389872 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.390033 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.390066 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 18:59:37.390170 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 18:59:37.390345 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"mutex_wait_us":1,"thread_start_us":850,"threads_started":1}
I20260809 18:59:37.391721 7365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.379326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37827 (local address 127.0.0.1:60690)
0809 18:59:37.382223 (+ 2897us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.382244 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:37.382469 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:37.383337 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:37.383344 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:37.383374 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:37.383824 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.383843 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.385676 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.385681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.387760 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.387773 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.389402 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.389409 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.389590 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.389643 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 18:59:37.391189 (+ 1546us) client_negotiation.cc:240] Negotiation successful
0809 18:59:37.391319 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2772,"mutex_wait_us":9,"thread_start_us":1874,"threads_started":1}
I20260809 18:59:37.391955 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.378964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:40205 (local address 127.0.0.1:37116)
0809 18:59:37.381582 (+ 2618us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.381622 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:37.381883 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:37.383929 (+ 2046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:37.383933 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:37.383954 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:37.384401 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.384410 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.385815 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.385820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.388253 (+ 2433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.388279 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.391129 (+ 2850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.391135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.391318 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.391348 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 18:59:37.391449 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 18:59:37.391568 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2377,"mutex_wait_us":22,"thread_start_us":3005,"threads_started":1}
I20260809 18:59:37.392887 7367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.379304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37116 (local address 127.16.188.195:40205)
0809 18:59:37.381026 (+ 1722us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.381033 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.381715 (+ 682us) server_negotiation.cc:407] Connection header received
0809 18:59:37.383243 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.383250 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.383495 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.383687 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:37.384546 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.385646 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.388453 (+ 2807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.390791 (+ 2338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.390974 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.391135 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.391508 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.391658 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1579,"thread_start_us":1433,"threads_started":1}
I20260809 18:59:37.394843 6826 tablet_service.cc:1467] Processing CreateTablet for tablet 39db5a79144b4ce4b726cefb5d1731e2 (DEFAULT_TABLE table=test-table [id=bf5dd428b80a439cbcc2ef2a9014ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:37.395206 7043 tablet_service.cc:1467] Processing CreateTablet for tablet 39db5a79144b4ce4b726cefb5d1731e2 (DEFAULT_TABLE table=test-table [id=bf5dd428b80a439cbcc2ef2a9014ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:37.396168 6826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39db5a79144b4ce4b726cefb5d1731e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:37.396569 7043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39db5a79144b4ce4b726cefb5d1731e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:37.396416 7246 tablet_service.cc:1467] Processing CreateTablet for tablet 39db5a79144b4ce4b726cefb5d1731e2 (DEFAULT_TABLE table=test-table [id=bf5dd428b80a439cbcc2ef2a9014ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:37.397791 7246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39db5a79144b4ce4b726cefb5d1731e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:37.406826 7375 tablet_bootstrap.cc:492] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Bootstrap starting.
I20260809 18:59:37.410246 7377 tablet_bootstrap.cc:492] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Bootstrap starting.
I20260809 18:59:37.410847 7375 tablet_bootstrap.cc:654] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:37.411581 7378 tablet_bootstrap.cc:492] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Bootstrap starting.
I20260809 18:59:37.412176 7375 log.cc:824] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:37.413487 7377 tablet_bootstrap.cc:654] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:37.414353 7377 log.cc:824] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:37.415318 7375 tablet_bootstrap.cc:492] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: No bootstrap required, opened a new log
I20260809 18:59:37.415540 7378 tablet_bootstrap.cc:654] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:37.415627 7375 ts_tablet_manager.cc:1397] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 18:59:37.416617 7377 tablet_bootstrap.cc:492] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: No bootstrap required, opened a new log
I20260809 18:59:37.416742 7378 log.cc:824] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:37.416834 7377 ts_tablet_manager.cc:1397] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 18:59:37.419562 7378 tablet_bootstrap.cc:492] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: No bootstrap required, opened a new log
I20260809 18:59:37.419798 7378 ts_tablet_manager.cc:1397] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 18:59:37.423969 7377 raft_consensus.cc:348] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.424299 7377 raft_consensus.cc:374] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:37.424413 7377 raft_consensus.cc:729] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df28bcd3fcba490c8859aa742e55ab00, State: Initialized, Role: FOLLOWER
I20260809 18:59:37.424939 7377 consensus_queue.cc:260] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.425347 7375 raft_consensus.cc:348] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.425788 7375 raft_consensus.cc:374] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:37.425937 7146 heartbeater.cc:503] Master 127.16.188.254:40467 was elected leader, sending a full tablet report...
I20260809 18:59:37.425915 7375 raft_consensus.cc:729] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 188ca871512f4ee2895c3b16ed2af686, State: Initialized, Role: FOLLOWER
I20260809 18:59:37.426728 7377 ts_tablet_manager.cc:1428] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20260809 18:59:37.426709 7375 consensus_queue.cc:260] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.428320 7375 ts_tablet_manager.cc:1428] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 18:59:37.429557 7378 raft_consensus.cc:348] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.430020 7378 raft_consensus.cc:374] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:37.430176 7378 raft_consensus.cc:729] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a226797d4446412e8e6b6a1ea4d068c9, State: Initialized, Role: FOLLOWER
I20260809 18:59:37.430805 7378 consensus_queue.cc:260] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.433633 7350 heartbeater.cc:503] Master 127.16.188.254:40467 was elected leader, sending a full tablet report...
I20260809 18:59:37.434019 7378 ts_tablet_manager.cc:1428] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
W20260809 18:59:37.561233 7351 tablet.cc:2369] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:59:37.561690 7147 tablet.cc:2369] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:59:37.571254 6932 tablet.cc:2369] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:37.642573 7388 raft_consensus.cc:482] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:37.642896 7388 raft_consensus.cc:504] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.644686 7388 leader_election.cc:288] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827), 188ca871512f4ee2895c3b16ed2af686 (127.16.188.193:36011)
I20260809 18:59:37.650779 7372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.645197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:46919 (local address 127.16.188.193:36011)
0809 18:59:37.645419 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.645425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.645473 (+ 48us) server_negotiation.cc:407] Connection header received
0809 18:59:37.645552 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.645557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.645638 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.645730 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:37.646118 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.647069 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.648880 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.650042 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.650152 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.650204 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.650515 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.650599 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 18:59:37.650904 7352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.644936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.16.188.195:46919)
0809 18:59:37.645226 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.645247 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:37.645379 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:37.645773 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:37.645778 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:37.645805 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:37.645975 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.645983 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.647198 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.647204 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.648733 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.648745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.650177 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.650183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.650368 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.650404 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 18:59:37.650501 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 18:59:37.650641 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260809 18:59:37.651786 7370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.645204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:55261 (local address 127.16.188.194:37827)
0809 18:59:37.645419 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.645425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.646068 (+ 643us) server_negotiation.cc:407] Connection header received
0809 18:59:37.646213 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.646218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.646292 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.646361 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:37.646906 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.647889 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.649884 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.650956 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.651101 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.651184 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.651431 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.651551 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 18:59:37.651881 7389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.644941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37827 (local address 127.16.188.195:55261)
0809 18:59:37.645964 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.645977 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:37.646089 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:37.646393 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:37.646397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:37.646421 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:37.646740 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.646751 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.648029 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.648032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.649729 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:37.649744 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.651162 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.651168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:37.651294 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.651317 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 18:59:37.651393 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 18:59:37.651506 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"mutex_wait_us":189,"thread_start_us":442,"threads_started":1}
I20260809 18:59:37.651861 6857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39db5a79144b4ce4b726cefb5d1731e2" candidate_uuid: "a226797d4446412e8e6b6a1ea4d068c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "188ca871512f4ee2895c3b16ed2af686" is_pre_election: true
I20260809 18:59:37.652400 6857 raft_consensus.cc:2454] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a226797d4446412e8e6b6a1ea4d068c9 in term 0.
I20260809 18:59:37.652814 7073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39db5a79144b4ce4b726cefb5d1731e2" candidate_uuid: "a226797d4446412e8e6b6a1ea4d068c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df28bcd3fcba490c8859aa742e55ab00" is_pre_election: true
I20260809 18:59:37.653069 7174 leader_election.cc:302] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 188ca871512f4ee2895c3b16ed2af686, a226797d4446412e8e6b6a1ea4d068c9; no voters:
I20260809 18:59:37.653287 7073 raft_consensus.cc:2454] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a226797d4446412e8e6b6a1ea4d068c9 in term 0.
I20260809 18:59:37.653460 7388 raft_consensus.cc:2781] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:37.653595 7388 raft_consensus.cc:482] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:37.653707 7388 raft_consensus.cc:3037] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:37.655989 7388 raft_consensus.cc:504] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.656569 7388 leader_election.cc:288] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [CANDIDATE]: Term 1 election: Requested vote from peers df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827), 188ca871512f4ee2895c3b16ed2af686 (127.16.188.193:36011)
I20260809 18:59:37.656946 7073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39db5a79144b4ce4b726cefb5d1731e2" candidate_uuid: "a226797d4446412e8e6b6a1ea4d068c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df28bcd3fcba490c8859aa742e55ab00"
I20260809 18:59:37.657058 6857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39db5a79144b4ce4b726cefb5d1731e2" candidate_uuid: "a226797d4446412e8e6b6a1ea4d068c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "188ca871512f4ee2895c3b16ed2af686"
I20260809 18:59:37.657181 7073 raft_consensus.cc:3037] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:37.657284 6857 raft_consensus.cc:3037] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:37.660313 6857 raft_consensus.cc:2454] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a226797d4446412e8e6b6a1ea4d068c9 in term 1.
I20260809 18:59:37.660313 7073 raft_consensus.cc:2454] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a226797d4446412e8e6b6a1ea4d068c9 in term 1.
I20260809 18:59:37.660676 7174 leader_election.cc:302] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 188ca871512f4ee2895c3b16ed2af686, a226797d4446412e8e6b6a1ea4d068c9; no voters:
I20260809 18:59:37.660964 7388 raft_consensus.cc:2781] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:37.661403 7388 raft_consensus.cc:686] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 LEADER]: Becoming Leader. State: Replica: a226797d4446412e8e6b6a1ea4d068c9, State: Running, Role: LEADER
I20260809 18:59:37.661849 7388 consensus_queue.cc:237] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } }
I20260809 18:59:37.666504 6623 catalog_manager.cc:5495] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "a226797d4446412e8e6b6a1ea4d068c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } health_report { overall_health: UNKNOWN } } }
I20260809 18:59:37.681499 7367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.676578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37124 (local address 127.16.188.195:40205)
0809 18:59:37.676762 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.676768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.676838 (+ 70us) server_negotiation.cc:407] Connection header received
0809 18:59:37.676993 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.676996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.677066 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.677209 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:37.677506 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.678187 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.679621 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.680027 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.680112 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.680547 (+ 435us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:37.680989 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:37.681120 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.681196 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.681257 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:59:37.689248 6857 raft_consensus.cc:1261] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Refusing update from remote peer a226797d4446412e8e6b6a1ea4d068c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:37.689248 7073 raft_consensus.cc:1261] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 1 FOLLOWER]: Refusing update from remote peer a226797d4446412e8e6b6a1ea4d068c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:37.690332 7392 consensus_queue.cc:1035] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:37.690672 7388 consensus_queue.cc:1035] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:37.701686 7395 mvcc.cc:205] Tried to move back new op lower bound from 7316692900605046784 to 7316692900506365952. Current Snapshot: MvccSnapshot[applied={T|T < 7316692900605046784}]
I20260809 18:59:37.702518 7396 mvcc.cc:205] Tried to move back new op lower bound from 7316692900605046784 to 7316692900506365952. Current Snapshot: MvccSnapshot[applied={T|T < 7316692900605046784}]
I20260809 18:59:37.714568 6623 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:37.714875 6623 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:37.718190 6623 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Sending DeleteTablet for 3 replicas of tablet 39db5a79144b4ce4b726cefb5d1731e2
I20260809 18:59:37.719146 7246 tablet_service.cc:1514] Processing DeleteTablet for tablet 39db5a79144b4ce4b726cefb5d1731e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:37 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:37116
I20260809 18:59:37.719271 6826 tablet_service.cc:1514] Processing DeleteTablet for tablet 39db5a79144b4ce4b726cefb5d1731e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:37 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:52120
I20260809 18:59:37.719586 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 6726
I20260809 18:59:37.719942 7408 tablet_replica.cc:330] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: stopping tablet replica
I20260809 18:59:37.719959 7043 tablet_service.cc:1514] Processing DeleteTablet for tablet 39db5a79144b4ce4b726cefb5d1731e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:37 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:60690
I20260809 18:59:37.720280 7408 raft_consensus.cc:2229] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:59:37.720937 7408 raft_consensus.cc:2258] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:37.722983 7408 ts_tablet_manager.cc:1905] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:37.728677 7408 ts_tablet_manager.cc:1918] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:37.728843 7408 log.cc:1196] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/39db5a79144b4ce4b726cefb5d1731e2
I20260809 18:59:37.729414 7408 ts_tablet_manager.cc:1939] T 39db5a79144b4ce4b726cefb5d1731e2 P a226797d4446412e8e6b6a1ea4d068c9: Deleting consensus metadata
I20260809 18:59:37.731194 6607 catalog_manager.cc:4841] TS a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205): tablet 39db5a79144b4ce4b726cefb5d1731e2 (table test-table [id=bf5dd428b80a439cbcc2ef2a9014ca1d]) successfully deleted
I20260809 18:59:37.733625 7411 tablet_replica.cc:330] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: stopping tablet replica
I20260809 18:59:37.734093 7411 raft_consensus.cc:2229] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:37.734629 7411 raft_consensus.cc:2258] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 09 18:59:37 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 18:59:37.736066 7410 tablet_replica.cc:330] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: stopping tablet replica
I20260809 18:59:37.736544 7410 raft_consensus.cc:2229] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:37.736981 7411 ts_tablet_manager.cc:1905] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:37.737128 7410 raft_consensus.cc:2258] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:37.739977 7410 ts_tablet_manager.cc:1905] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:37.743837 7411 ts_tablet_manager.cc:1918] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:37.744029 7411 log.cc:1196] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/39db5a79144b4ce4b726cefb5d1731e2
I20260809 18:59:37.744542 7411 ts_tablet_manager.cc:1939] T 39db5a79144b4ce4b726cefb5d1731e2 P df28bcd3fcba490c8859aa742e55ab00: Deleting consensus metadata
I20260809 18:59:37.744553 7372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.720762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52128 (local address 127.16.188.193:36011)
0809 18:59:37.720930 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.720936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.721070 (+ 134us) server_negotiation.cc:407] Connection header received
0809 18:59:37.721365 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.721370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.721451 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.721546 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:37.723455 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.724652 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.726690 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.727366 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.727494 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.736946 (+ 9452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:37.736957 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:37.736972 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:37.737018 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:37.740745 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:37.741696 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:37.741705 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:37.741708 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:37.741892 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:37.742414 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:37.742419 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:37.742422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:37.742883 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:37.743179 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.743829 (+ 650us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.744070 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 18:59:37.746146 6924 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:37.746336 6609 catalog_manager.cc:4841] TS df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827): tablet 39db5a79144b4ce4b726cefb5d1731e2 (table test-table [id=bf5dd428b80a439cbcc2ef2a9014ca1d]) successfully deleted
I20260809 18:59:37.849575 7410 ts_tablet_manager.cc:1918] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:37.849829 7410 log.cc:1196] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/39db5a79144b4ce4b726cefb5d1731e2
I20260809 18:59:37.850325 7410 ts_tablet_manager.cc:1939] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Deleting consensus metadata
I20260809 18:59:37.850380 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 6726
W20260809 18:59:37.875022 6605 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.188.193:36011 (error 108)
I20260809 18:59:37.875543 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 6939
I20260809 18:59:37.877560 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.877048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52136)
0809 18:59:37.877311 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.877421 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260809 18:59:37.877796 6605 catalog_manager.cc:4584] TS 188ca871512f4ee2895c3b16ed2af686 (127.16.188.193:36011): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 39db5a79144b4ce4b726cefb5d1731e2: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Aug 09 18:59:37 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:59:37.893445 7370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.876375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60692 (local address 127.16.188.194:37827)
0809 18:59:37.876550 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:37.876556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:37.876652 (+ 96us) server_negotiation.cc:407] Connection header received
0809 18:59:37.876843 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:37.876849 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:37.876954 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:37.877057 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:37.878986 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.879866 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.881723 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:37.882094 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:37.882184 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:37.887073 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:37.887092 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:37.887113 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:37.887168 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:37.890741 (+ 3573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:37.891391 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:37.891398 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:37.891400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:37.891523 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:37.891872 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:37.891875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:37.891877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:37.892258 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:37.892529 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:37.892892 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 18:59:37.893141 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 18:59:37.894110 7140 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:37.931385 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.930924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52152)
0809 18:59:37.931131 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.931230 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 18:59:37.932482 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.932123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52162)
0809 18:59:37.932285 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.932368 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 18:59:37.992792 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.992334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52166)
0809 18:59:37.992533 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.992622 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 18:59:37.993882 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:37.993542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52182)
0809 18:59:37.993690 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:37.993760 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 18:59:38.041198 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 6939
I20260809 18:59:38.062680 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 7151
Aug 09 18:59:38 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 18:59:38.074558 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:38.073999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52186)
0809 18:59:38.074235 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:38.074344 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 18:59:38.075708 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:38.075340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52202)
0809 18:59:38.075528 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:38.075598 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 18:59:38.080122 7367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:38.063437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37126 (local address 127.16.188.195:40205)
0809 18:59:38.063633 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:38.063639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:38.063664 (+ 25us) server_negotiation.cc:407] Connection header received
0809 18:59:38.063827 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:38.063834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:38.063927 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:38.064044 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:38.065353 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:38.066598 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:38.067795 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:38.068443 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:38.068587 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:38.073502 (+ 4915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:38.073519 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:38.073541 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:38.073583 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:38.077186 (+ 3603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:38.077962 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:38.077969 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:38.077972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:38.078154 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:38.078553 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:38.078556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:38.078558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:38.078974 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:38.079247 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:38.079608 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 18:59:38.079790 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 18:59:38.080858 7344 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:38.199867 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 7151
I20260809 18:59:38.224268 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 6577
I20260809 18:59:38.225401 6669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:38.334806 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:38.333211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:52218)
0809 18:59:38.334476 (+ 1265us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:38.334612 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1119}
I20260809 18:59:38.335279 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 6577
I20260809 18:59:38.362987 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40467
--webserver_interface=127.16.188.254
--webserver_port=39473
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:40467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:38.700435 7422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:38.700840 7422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:38.700982 7422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:38.708890 7422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:38.709003 7422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:38.709107 7422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:38.709198 7422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:38.709259 7422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:38.719908 7422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:40467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=39473
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:38.721211 7422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:38.722527 7422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:38.746762 7437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:38.746742 7435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:38.746865 7433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:38.747447 7422 server_base.cc:1034] running on GCE node
I20260809 18:59:38.748313 7422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:38.749882 7422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:38.751119 7422 hybrid_clock.cc:648] HybridClock initialized: now 1786301978751043 us; error 49 us; skew 500 ppm
I20260809 18:59:38.751515 7422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:38 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301978, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:38.755017 7422 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:59:38.756685 7422 webserver.cc:460] Webserver started at http://127.16.188.254:39473/ using document root <none> and password file <none>
I20260809 18:59:38.757443 7422 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:38.757637 7422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:38.763484 7422 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 18:59:38.766413 7447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:38.767786 7422 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:59:38.767940 7422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "5265e67decf54a9b9449e1fab8894375"
format_stamp: "Formatted at 2026-08-09 18:59:35 on dist-test-slave-266d"
server_key: "2e65e3fc82444e640047edd011d98ef6"
server_key_iv: "684fc4a2a9989f40abcdf03478387801"
server_key_version: "encryptionkey@0"
I20260809 18:59:38.768934 7422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:38.780335 7422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:38.784228 7422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:38.784457 7422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:38.802026 7422 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:40467
I20260809 18:59:38.802086 7521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:40467 every 8 connection(s)
I20260809 18:59:38.803498 7422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:38.807577 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 7422
I20260809 18:59:38.808389 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:36011
--local_ip_for_outbound_sockets=127.16.188.193
--tserver_master_addrs=127.16.188.254:40467
--webserver_port=43243
--webserver_interface=127.16.188.193
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:38.810570 7522 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:59:38.813912 7522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Bootstrap starting.
I20260809 18:59:38.833371 7522 log.cc:824] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:38.845960 7522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:38.846457 7522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Bootstrap complete.
I20260809 18:59:38.855412 7522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:38.856227 7522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5265e67decf54a9b9449e1fab8894375, State: Initialized, Role: FOLLOWER
I20260809 18:59:38.856818 7522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:38.857041 7522 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:38.857174 7522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:38.857347 7522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:59:38.861025 7522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:38.861546 7522 leader_election.cc:302] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5265e67decf54a9b9449e1fab8894375; no voters:
I20260809 18:59:38.862162 7522 leader_election.cc:288] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:59:38.862305 7528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:59:38.863453 7528 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 2 LEADER]: Becoming Leader. State: Replica: 5265e67decf54a9b9449e1fab8894375, State: Running, Role: LEADER
I20260809 18:59:38.864040 7528 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:38.864398 7522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:38.866487 7531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5265e67decf54a9b9449e1fab8894375. Latest consensus state: current_term: 2 leader_uuid: "5265e67decf54a9b9449e1fab8894375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } } }
I20260809 18:59:38.866899 7531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:38.867406 7530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5265e67decf54a9b9449e1fab8894375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } } }
I20260809 18:59:38.867683 7530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:38.878268 7537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:38.886338 7537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:38.887797 7537 catalog_manager.cc:1259] Loaded cluster ID: e61b64365d624fd5b6d003904a42a7e6
I20260809 18:59:38.887959 7537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:59:38.891188 7537 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 18:59:38.973017 7537 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 18:59:39.031658 7537 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:59:39.044051 7537 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Loaded TSK: 0
I20260809 18:59:39.054558 7537 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:59:39.682088 7525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:39.683166 7525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:39.683799 7525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:39.709570 7525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:39.709980 7525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:39.710696 7525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:59:39.739476 7525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:36011
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=43243
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:39.741842 7525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:39.744364 7525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:39.803324 7562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:39.804154 7568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:39.810146 7563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:39.813416 7525 server_base.cc:1034] running on GCE node
I20260809 18:59:39.815716 7525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:39.819789 7525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:39.824064 7525 hybrid_clock.cc:648] HybridClock initialized: now 1786301979823857 us; error 204 us; skew 500 ppm
I20260809 18:59:39.825405 7525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:39 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301979, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:39.836161 7525 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:59:39.857736 7525 webserver.cc:460] Webserver started at http://127.16.188.193:43243/ using document root <none> and password file <none>
I20260809 18:59:39.864320 7525 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:39.865541 7525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:39.912127 7525 fs_manager.cc:709] Time spent opening directory manager: real 0.029s user 0.023s sys 0.001s
I20260809 18:59:39.926556 7576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:39.932582 7525 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.004s sys 0.002s
I20260809 18:59:39.933049 7525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "188ca871512f4ee2895c3b16ed2af686"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "56d301c61bf43e56c630769e0e8a6965"
server_key_iv: "6748705cc43846e52da831cacfbee805"
server_key_version: "encryptionkey@0"
I20260809 18:59:39.937376 7525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:40.065057 7525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:40.080895 7525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:40.081980 7525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:40.083927 7525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:40.090603 7588 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260809 18:59:40.109301 7588 ts_tablet_manager.cc:1852] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260809 18:59:40.111186 7588 ts_tablet_manager.cc:1905] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:40.135906 7588 ts_tablet_manager.cc:1918] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:40.136991 7588 ts_tablet_manager.cc:1939] T 39db5a79144b4ce4b726cefb5d1731e2 P 188ca871512f4ee2895c3b16ed2af686: Deleting consensus metadata
I20260809 18:59:40.138585 7525 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260809 18:59:40.138928 7525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.050s user 0.000s sys 0.003s
I20260809 18:59:40.139343 7525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:40.139518 7525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:40.247893 7525 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:36011
I20260809 18:59:40.247936 7742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:36011 every 8 connection(s)
I20260809 18:59:40.249193 7525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:40.254136 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 7525
I20260809 18:59:40.254778 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:37827
--local_ip_for_outbound_sockets=127.16.188.194
--tserver_master_addrs=127.16.188.254:40467
--webserver_port=42119
--webserver_interface=127.16.188.194
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:59:40 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301979, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:40.273243 7746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:40.251976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:35525 (local address 127.16.188.254:40467)
0809 18:59:40.252641 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:40.252652 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:40.253397 (+ 745us) server_negotiation.cc:407] Connection header received
0809 18:59:40.255606 (+ 2209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:40.255627 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:40.256069 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:40.256490 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:40.257921 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:40.259713 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:40.261438 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:40.262434 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:40.262635 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:40.265983 (+ 3348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:40.265990 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:40.266004 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:40.266050 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:40.269034 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:40.269932 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:40.269939 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:40.269945 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:40.270129 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:40.270556 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:40.270578 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:40.270580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:40.271020 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:40.271188 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:40.272028 (+ 840us) server_negotiation.cc:299] Negotiation successful
0809 18:59:40.272350 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":297,"threads_started":1}
I20260809 18:59:40.273535 7747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:40.252245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:35525)
0809 18:59:40.253124 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:40.253169 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:40.255014 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:40.256588 (+ 1574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:40.256598 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:40.257064 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:40.257651 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:40.257690 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:40.259882 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:40.259886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:40.261298 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:40.261311 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:40.262625 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:40.262629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:40.262797 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:40.263454 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:40.263474 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:40.265700 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:40.269205 (+ 3505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:40.269214 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:40.269230 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:40.269782 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:40.270244 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:40.270248 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:40.270251 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:40.270461 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:40.271171 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:40.271179 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:40.271550 (+ 371us) client_negotiation.cc:769] Sending connection context
0809 18:59:40.271814 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 18:59:40.272319 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":341,"threads_started":1}
I20260809 18:59:40.276530 7743 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40467
I20260809 18:59:40.276865 7743 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:40.277734 7743 heartbeater.cc:511] Master 127.16.188.254:40467 requested a full tablet report, sending...
I20260809 18:59:40.280186 7468 ts_manager.cc:194] Registered new tserver with Master: 188ca871512f4ee2895c3b16ed2af686 (127.16.188.193:36011)
I20260809 18:59:40.282318 7468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:35525
W20260809 18:59:40.582650 7749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:40.582904 7749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:40.583003 7749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:40.589900 7749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:40.589995 7749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:40.590116 7749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:59:40.599177 7749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:37827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=42119
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:40.600265 7749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:40.601465 7749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:40.613935 7756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:40.613929 7757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:40.613935 7761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:40.615224 7749 server_base.cc:1034] running on GCE node
I20260809 18:59:40.615751 7749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:40.616837 7749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:40.618021 7749 hybrid_clock.cc:648] HybridClock initialized: now 1786301980617968 us; error 49 us; skew 500 ppm
I20260809 18:59:40.618343 7749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:40 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301980, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:40.621424 7749 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:59:40.622759 7749 webserver.cc:460] Webserver started at http://127.16.188.194:42119/ using document root <none> and password file <none>
I20260809 18:59:40.623364 7749 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:40.623477 7749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:40.628369 7749 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260809 18:59:40.630857 7768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:40.632091 7749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:59:40.632239 7749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "df28bcd3fcba490c8859aa742e55ab00"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "5b80805db79da73c2810d49ac4881c65"
server_key_iv: "0a771bfc1280f734f5988ac0d6e4fd18"
server_key_version: "encryptionkey@0"
I20260809 18:59:40.633165 7749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:40.650125 7749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:40.653673 7749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:40.653903 7749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:40.654846 7749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:40.656104 7749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:40.656189 7749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:40.656302 7749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:40.656381 7749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:40.686483 7749 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:37827
I20260809 18:59:40.686549 7942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:37827 every 8 connection(s)
I20260809 18:59:40.687913 7749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:40.693418 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 7749
I20260809 18:59:40.694022 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:40205
--local_ip_for_outbound_sockets=127.16.188.195
--tserver_master_addrs=127.16.188.254:40467
--webserver_port=34545
--webserver_interface=127.16.188.195
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:59:40 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301980, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:40.709000 7746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:40.690273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:35167 (local address 127.16.188.254:40467)
0809 18:59:40.690497 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:40.690501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:40.691564 (+ 1063us) server_negotiation.cc:407] Connection header received
0809 18:59:40.693431 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:40.693435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:40.693505 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:40.693613 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:40.695075 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:40.695784 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:40.697333 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:40.697764 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:40.697872 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:40.703767 (+ 5895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:40.703772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:40.703775 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:40.703808 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:40.706191 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:40.706871 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:40.706875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:40.706877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:40.706999 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:40.707397 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:40.707400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:40.707402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:40.707661 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:40.707795 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:40.708447 (+ 652us) server_negotiation.cc:299] Negotiation successful
0809 18:59:40.708687 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 18:59:40.709908 7945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:40.690723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:35167)
0809 18:59:40.691404 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:40.691440 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:40.693146 (+ 1706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:40.693858 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:40.693865 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:40.694385 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:40.694914 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:40.694930 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:40.695936 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:40.695940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:40.697181 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:40.697194 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:40.697976 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:40.697983 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:40.698203 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:40.701384 (+ 3181us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:40.701406 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:40.703562 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:40.706337 (+ 2775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:40.706345 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:40.706360 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:40.706741 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:40.707101 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:40.707106 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:40.707110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:40.707285 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:40.707790 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:40.707798 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:40.708103 (+ 305us) client_negotiation.cc:769] Sending connection context
0809 18:59:40.708327 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 18:59:40.708814 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":258,"threads_started":1}
I20260809 18:59:40.711264 7943 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40467
I20260809 18:59:40.711577 7943 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:40.712414 7943 heartbeater.cc:511] Master 127.16.188.254:40467 requested a full tablet report, sending...
I20260809 18:59:40.714049 7468 ts_manager.cc:194] Registered new tserver with Master: df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827)
I20260809 18:59:40.715143 7468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:35167
W20260809 18:59:41.026530 7947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:41.026793 7947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:41.026928 7947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:41.033972 7947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:41.034073 7947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:41.034228 7947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:59:41.043853 7947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:40205
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=34545
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:41.045032 7947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:41.046355 7947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:41.058701 7962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:41.058743 7954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:41.058765 7956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:41.059490 7947 server_base.cc:1034] running on GCE node
I20260809 18:59:41.060051 7947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:41.060905 7947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:41.062096 7947 hybrid_clock.cc:648] HybridClock initialized: now 1786301981062047 us; error 42 us; skew 500 ppm
I20260809 18:59:41.062377 7947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:41 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301981, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:41.065289 7947 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:59:41.066602 7947 webserver.cc:460] Webserver started at http://127.16.188.195:34545/ using document root <none> and password file <none>
I20260809 18:59:41.067229 7947 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:41.067356 7947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:41.072252 7947 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:41.074857 7972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:41.076042 7947 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:59:41.076181 7947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "a226797d4446412e8e6b6a1ea4d068c9"
format_stamp: "Formatted at 2026-08-09 18:59:37 on dist-test-slave-266d"
server_key: "a693ca3022c5ea18101400625de7ba36"
server_key_iv: "a5c418f1749f504851d8cd0c7853a964"
server_key_version: "encryptionkey@0"
I20260809 18:59:41.077168 7947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:41.109704 7947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:41.113605 7947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:41.113865 7947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:41.114845 7947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:41.116153 7947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:41.116257 7947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:41.116384 7947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:41.116454 7947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:41.145659 7947 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:40205
I20260809 18:59:41.145718 8137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:40205 every 8 connection(s)
I20260809 18:59:41.147080 7947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:41.152242 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 7947
Aug 09 18:59:41 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301981, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 18:59:41.167841 7746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.149435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:35505 (local address 127.16.188.254:40467)
0809 18:59:41.149655 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.149662 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.150810 (+ 1148us) server_negotiation.cc:407] Connection header received
0809 18:59:41.152947 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.152954 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.153043 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.153179 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:41.154661 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.155720 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.157287 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.157951 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.158073 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.161871 (+ 3798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:41.161876 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:41.161879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:41.161910 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:41.164743 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.165629 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.165633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.165635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.165752 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.166215 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.166218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.166220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.166455 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:41.166589 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.167226 (+ 637us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.167450 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 18:59:41.168635 8140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.149969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:35505)
0809 18:59:41.150656 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.150699 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:41.152680 (+ 1981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:41.153430 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:41.153439 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:41.153938 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:41.154495 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.154512 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.155876 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.155879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.157124 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.157142 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.158413 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.158420 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.158625 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.159231 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:41.159253 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:41.161668 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:41.164892 (+ 3224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:41.164900 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:41.164916 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:41.165518 (+ 602us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:41.165854 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:41.165859 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:41.165863 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:41.166105 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:41.166582 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:41.166588 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:41.166878 (+ 290us) client_negotiation.cc:769] Sending connection context
0809 18:59:41.167088 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 18:59:41.167526 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":268,"threads_started":1}
I20260809 18:59:41.170030 8138 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40467
I20260809 18:59:41.170315 8138 heartbeater.cc:464] Registering TS with master...
I20260809 18:59:41.171113 8138 heartbeater.cc:511] Master 127.16.188.254:40467 requested a full tablet report, sending...
I20260809 18:59:41.171912 8142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.157636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40550 (local address 127.16.188.254:40467)
0809 18:59:41.158565 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.158570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.158586 (+ 16us) server_negotiation.cc:407] Connection header received
0809 18:59:41.158626 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.158629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.158675 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.158759 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:41.160331 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.161320 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.162904 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.163591 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.163705 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.166625 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:41.166631 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:41.166635 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:41.166661 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:41.169456 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.170215 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.170220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.170224 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.170356 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.170731 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.170734 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.170736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.170974 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:41.171163 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.171494 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.171655 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":829,"thread_start_us":686,"threads_started":1}
I20260809 18:59:41.172993 7467 ts_manager.cc:194] Registered new tserver with Master: a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205)
I20260809 18:59:41.174079 7467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:35505
I20260809 18:59:41.174566 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:59:41.181193 8142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.175406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40552 (local address 127.16.188.254:40467)
0809 18:59:41.175535 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.175539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.175993 (+ 454us) server_negotiation.cc:407] Connection header received
0809 18:59:41.176202 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.176205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.176331 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.176448 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:41.176858 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.177588 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.179058 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.179478 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.179583 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.180072 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:41.180530 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:41.180661 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.180764 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.180834 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:59:41.181991 7467 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:59:41.189034 7467 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:59:41.222213 8159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.200040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59618)
0809 18:59:41.213664 (+ 13624us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.213681 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:41.213781 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:41.215296 (+ 1515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:41.215303 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:41.215334 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:41.215803 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.215817 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.217606 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.217610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.219795 (+ 2185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.219808 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.221268 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.221274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.221463 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.221513 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 18:59:41.221643 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 18:59:41.221830 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13501,"mutex_wait_us":51,"thread_start_us":12483,"threads_started":1}
I20260809 18:59:41.222625 8157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.200553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.16.188.193:36011)
0809 18:59:41.214440 (+ 13887us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.214450 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.214479 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:59:41.214582 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.214590 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.214822 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.215016 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:41.216005 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.217474 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.219944 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.221017 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.221195 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.221376 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.221977 (+ 601us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.222137 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13749,"thread_start_us":13639,"threads_started":1}
I20260809 18:59:41.223856 8155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.199868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37827 (local address 127.0.0.1:57338)
0809 18:59:41.212890 (+ 13022us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.212938 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:41.213118 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:41.217171 (+ 4053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:41.217176 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:41.217201 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:41.217531 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.217541 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.219245 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.219250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.221035 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.221046 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.223135 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.223141 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.223293 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.223321 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 18:59:41.223399 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:59:41.223522 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12791,"thread_start_us":15200,"threads_started":1}
I20260809 18:59:41.223905 8156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.200194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57338 (local address 127.16.188.194:37827)
0809 18:59:41.216641 (+ 16447us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.216649 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.216679 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:59:41.216779 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.216786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.216972 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.217170 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:41.217696 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.219113 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.221287 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.222686 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.222842 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.222999 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.223472 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.223626 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16301,"thread_start_us":16208,"threads_started":1}
I20260809 18:59:41.223977 8153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.200519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:40205 (local address 127.0.0.1:40244)
0809 18:59:41.215308 (+ 14789us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.215324 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:41.215448 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:41.216196 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:41.216201 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:41.216242 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:41.216589 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.216601 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.218212 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.218218 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.220480 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.220495 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.222368 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.222374 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.222796 (+ 422us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.222828 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 18:59:41.223471 (+ 643us) client_negotiation.cc:240] Negotiation successful
0809 18:59:41.223597 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14675,"mutex_wait_us":26,"thread_start_us":13322,"threads_started":1}
I20260809 18:59:41.224733 8161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.200768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40244 (local address 127.16.188.195:40205)
0809 18:59:41.214914 (+ 14146us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.214921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.215574 (+ 653us) server_negotiation.cc:407] Connection header received
0809 18:59:41.215670 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.215676 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.215903 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.216069 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:41.216782 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.218046 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.220642 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.221898 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.222068 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.222223 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.224083 (+ 1860us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.224235 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13979,"thread_start_us":13792,"threads_started":1}
I20260809 18:59:41.224784 7647 tablet_service.cc:1467] Processing CreateTablet for tablet 0901b7266eee4955989a5dffa0caf999 (DEFAULT_TABLE table=test-table [id=1c0cffe88d9f407b93e61a9398a7f07a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:41.226128 7647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0901b7266eee4955989a5dffa0caf999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:41.227847 7844 tablet_service.cc:1467] Processing CreateTablet for tablet 0901b7266eee4955989a5dffa0caf999 (DEFAULT_TABLE table=test-table [id=1c0cffe88d9f407b93e61a9398a7f07a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:41.228276 8047 tablet_service.cc:1467] Processing CreateTablet for tablet 0901b7266eee4955989a5dffa0caf999 (DEFAULT_TABLE table=test-table [id=1c0cffe88d9f407b93e61a9398a7f07a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:59:41.229260 7844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0901b7266eee4955989a5dffa0caf999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:41.229642 8047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0901b7266eee4955989a5dffa0caf999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:59:41.233876 8162 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Bootstrap starting.
I20260809 18:59:41.236898 8162 tablet_bootstrap.cc:654] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:41.238304 8162 log.cc:824] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:41.240621 8162 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: No bootstrap required, opened a new log
I20260809 18:59:41.240849 8162 ts_tablet_manager.cc:1397] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260809 18:59:41.245465 8168 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Bootstrap starting.
I20260809 18:59:41.246966 8166 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Bootstrap starting.
I20260809 18:59:41.248920 8168 tablet_bootstrap.cc:654] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:41.249675 8166 tablet_bootstrap.cc:654] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Neither blocks nor log segments found. Creating new log.
I20260809 18:59:41.250147 8168 log.cc:824] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:41.250635 8166 log.cc:824] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:41.254510 8168 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: No bootstrap required, opened a new log
I20260809 18:59:41.254817 8168 ts_tablet_manager.cc:1397] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260809 18:59:41.259581 8166 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: No bootstrap required, opened a new log
I20260809 18:59:41.259878 8166 ts_tablet_manager.cc:1397] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260809 18:59:41.260095 8162 raft_consensus.cc:348] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:41.260648 8162 raft_consensus.cc:374] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:41.260792 8162 raft_consensus.cc:729] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 188ca871512f4ee2895c3b16ed2af686, State: Initialized, Role: FOLLOWER
I20260809 18:59:41.261576 8162 consensus_queue.cc:260] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:41.263417 7743 heartbeater.cc:503] Master 127.16.188.254:40467 was elected leader, sending a full tablet report...
I20260809 18:59:41.264148 8162 ts_tablet_manager.cc:1428] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Time spent starting tablet: real 0.023s user 0.004s sys 0.010s
I20260809 18:59:41.265829 8168 raft_consensus.cc:348] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:41.266234 8168 raft_consensus.cc:374] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:41.266335 8168 raft_consensus.cc:729] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df28bcd3fcba490c8859aa742e55ab00, State: Initialized, Role: FOLLOWER
I20260809 18:59:41.266911 8168 consensus_queue.cc:260] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:41.268129 7943 heartbeater.cc:503] Master 127.16.188.254:40467 was elected leader, sending a full tablet report...
I20260809 18:59:41.268543 8168 ts_tablet_manager.cc:1428] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260809 18:59:41.270648 8166 raft_consensus.cc:348] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:41.270961 8166 raft_consensus.cc:374] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:59:41.271060 8166 raft_consensus.cc:729] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a226797d4446412e8e6b6a1ea4d068c9, State: Initialized, Role: FOLLOWER
I20260809 18:59:41.271641 8166 consensus_queue.cc:260] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:41.272667 8138 heartbeater.cc:503] Master 127.16.188.254:40467 was elected leader, sending a full tablet report...
I20260809 18:59:41.273239 8166 ts_tablet_manager.cc:1428] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 18:59:41.376461 8174 raft_consensus.cc:482] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:41.376765 8174 raft_consensus.cc:504] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:41.378546 8174 leader_election.cc:288] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 188ca871512f4ee2895c3b16ed2af686 (127.16.188.193:36011), a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205)
I20260809 18:59:41.386932 8161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.379122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:57913 (local address 127.16.188.195:40205)
0809 18:59:41.379303 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.379309 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.380102 (+ 793us) server_negotiation.cc:407] Connection header received
0809 18:59:41.380301 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.380306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.380372 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.380437 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:41.381171 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.382170 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.384621 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.385853 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.385999 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.386073 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.386550 (+ 477us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.386676 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:59:41.386938 8157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.378893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:55925 (local address 127.16.188.193:36011)
0809 18:59:41.379154 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.379160 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.379772 (+ 612us) server_negotiation.cc:407] Connection header received
0809 18:59:41.379967 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.379972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.380034 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.380119 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:59:41.380836 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.381939 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.384637 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.385853 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.385996 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.386073 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.386550 (+ 477us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.386676 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:59:41.387156 8179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.378728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.16.188.194:55925)
0809 18:59:41.379661 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.379676 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:41.379833 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:41.380164 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:41.380169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:41.380193 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:41.380675 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.380694 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.382089 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.382093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.384489 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.384499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.386108 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.386115 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.386348 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.386416 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 18:59:41.386506 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 18:59:41.386680 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"mutex_wait_us":162,"thread_start_us":609,"threads_started":1}
I20260809 18:59:41.387207 8180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.379111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:40205 (local address 127.16.188.194:57913)
0809 18:59:41.379993 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.380009 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:41.380163 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:41.380494 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:41.380499 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:41.380525 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:59:41.380975 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.380986 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.382312 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.382317 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.384477 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:41.384493 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.386116 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.386121 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:41.386368 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.386428 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 18:59:41.386506 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:59:41.386683 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"mutex_wait_us":109,"thread_start_us":515,"threads_started":1}
I20260809 18:59:41.388132 8075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0901b7266eee4955989a5dffa0caf999" candidate_uuid: "df28bcd3fcba490c8859aa742e55ab00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a226797d4446412e8e6b6a1ea4d068c9" is_pre_election: true
I20260809 18:59:41.388224 7681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0901b7266eee4955989a5dffa0caf999" candidate_uuid: "df28bcd3fcba490c8859aa742e55ab00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "188ca871512f4ee2895c3b16ed2af686" is_pre_election: true
I20260809 18:59:41.388622 8075 raft_consensus.cc:2454] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df28bcd3fcba490c8859aa742e55ab00 in term 0.
I20260809 18:59:41.388679 7681 raft_consensus.cc:2454] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df28bcd3fcba490c8859aa742e55ab00 in term 0.
I20260809 18:59:41.389289 7773 leader_election.cc:302] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a226797d4446412e8e6b6a1ea4d068c9, df28bcd3fcba490c8859aa742e55ab00; no voters:
I20260809 18:59:41.389663 8174 raft_consensus.cc:2781] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:59:41.389796 8174 raft_consensus.cc:482] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:59:41.389895 8174 raft_consensus.cc:3037] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:41.392045 8174 raft_consensus.cc:504] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:41.392666 8174 leader_election.cc:288] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [CANDIDATE]: Term 1 election: Requested vote from peers 188ca871512f4ee2895c3b16ed2af686 (127.16.188.193:36011), a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205)
I20260809 18:59:41.393049 7681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0901b7266eee4955989a5dffa0caf999" candidate_uuid: "df28bcd3fcba490c8859aa742e55ab00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "188ca871512f4ee2895c3b16ed2af686"
I20260809 18:59:41.393149 8075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0901b7266eee4955989a5dffa0caf999" candidate_uuid: "df28bcd3fcba490c8859aa742e55ab00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a226797d4446412e8e6b6a1ea4d068c9"
I20260809 18:59:41.393294 7681 raft_consensus.cc:3037] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:41.393343 8075 raft_consensus.cc:3037] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:59:41.396418 7681 raft_consensus.cc:2454] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df28bcd3fcba490c8859aa742e55ab00 in term 1.
I20260809 18:59:41.396418 8075 raft_consensus.cc:2454] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df28bcd3fcba490c8859aa742e55ab00 in term 1.
I20260809 18:59:41.396800 7771 leader_election.cc:302] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 188ca871512f4ee2895c3b16ed2af686, df28bcd3fcba490c8859aa742e55ab00; no voters:
I20260809 18:59:41.397070 8174 raft_consensus.cc:2781] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:59:41.397522 8174 raft_consensus.cc:686] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 1 LEADER]: Becoming Leader. State: Replica: df28bcd3fcba490c8859aa742e55ab00, State: Running, Role: LEADER
I20260809 18:59:41.398012 8174 consensus_queue.cc:237] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
W20260809 18:59:41.398584 8139 tablet.cc:2369] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:41.402679 7467 catalog_manager.cc:5495] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 reported cstate change: term changed from 0 to 1, leader changed from <none> to df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194). New cstate: current_term: 1 leader_uuid: "df28bcd3fcba490c8859aa742e55ab00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } health_report { overall_health: UNKNOWN } } }
W20260809 18:59:41.439718 7944 tablet.cc:2369] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:59:41.462272 8156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.456393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57352 (local address 127.16.188.194:37827)
0809 18:59:41.456617 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.456622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.456677 (+ 55us) server_negotiation.cc:407] Connection header received
0809 18:59:41.456865 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.456869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.456949 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.457069 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:59:41.457415 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.458278 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.460197 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.460592 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.460686 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.461248 (+ 562us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:59:41.461736 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:59:41.461858 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.461934 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.461996 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 18:59:41.470161 7681 raft_consensus.cc:1261] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Refusing update from remote peer df28bcd3fcba490c8859aa742e55ab00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:41.470176 8075 raft_consensus.cc:1261] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 FOLLOWER]: Refusing update from remote peer df28bcd3fcba490c8859aa742e55ab00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:59:41.471011 8181 consensus_queue.cc:1035] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:41.471359 8174 consensus_queue.cc:1035] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:59:41.493795 7468 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:41.494031 7468 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:59:41.497354 7468 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Sending DeleteTablet for 3 replicas of tablet 0901b7266eee4955989a5dffa0caf999
I20260809 18:59:41.498605 7844 tablet_service.cc:1514] Processing DeleteTablet for tablet 0901b7266eee4955989a5dffa0caf999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:41 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:57338
I20260809 18:59:41.498799 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 7525
I20260809 18:59:41.499291 8047 tablet_service.cc:1514] Processing DeleteTablet for tablet 0901b7266eee4955989a5dffa0caf999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:41 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:40244
I20260809 18:59:41.500272 7647 tablet_service.cc:1514] Processing DeleteTablet for tablet 0901b7266eee4955989a5dffa0caf999 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:59:41 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:59618
I20260809 18:59:41.509532 8204 tablet_replica.cc:330] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: stopping tablet replica
I20260809 18:59:41.510111 8204 raft_consensus.cc:2229] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:41.510730 8204 raft_consensus.cc:2258] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:41.513195 8204 ts_tablet_manager.cc:1905] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:41.518554 8157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.499754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59630 (local address 127.16.188.193:36011)
0809 18:59:41.499942 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.499948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.499968 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:59:41.500192 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.500199 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.500300 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.500395 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:41.502582 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.503823 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.505983 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.506693 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.506820 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.510586 (+ 3766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:41.510601 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:41.510631 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:41.510672 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:41.514508 (+ 3836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.515359 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.515367 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.515371 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.515533 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.515983 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.515989 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.515992 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.516458 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:41.516769 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.517943 (+ 1174us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.518186 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 18:59:41.519529 7737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:41.519629 8203 tablet_replica.cc:330] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: stopping tablet replica
I20260809 18:59:41.520069 8203 raft_consensus.cc:2229] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:59:41.520797 8203 raft_consensus.cc:2258] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:59:41.523154 8203 ts_tablet_manager.cc:1905] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:59:41.526221 8204 ts_tablet_manager.cc:1918] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:41.527357 8204 log.cc:1196] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/0901b7266eee4955989a5dffa0caf999
I20260809 18:59:41.528170 8204 ts_tablet_manager.cc:1939] T 0901b7266eee4955989a5dffa0caf999 P a226797d4446412e8e6b6a1ea4d068c9: Deleting consensus metadata
I20260809 18:59:41.530682 7450 catalog_manager.cc:4841] TS a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205): tablet 0901b7266eee4955989a5dffa0caf999 (table test-table [id=1c0cffe88d9f407b93e61a9398a7f07a]) successfully deleted
I20260809 18:59:41.530763 8203 ts_tablet_manager.cc:1918] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:59:41.530908 8203 log.cc:1196] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/0901b7266eee4955989a5dffa0caf999
I20260809 18:59:41.531474 8203 ts_tablet_manager.cc:1939] T 0901b7266eee4955989a5dffa0caf999 P df28bcd3fcba490c8859aa742e55ab00: Deleting consensus metadata
I20260809 18:59:41.533416 7451 catalog_manager.cc:4841] TS df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827): tablet 0901b7266eee4955989a5dffa0caf999 (table test-table [id=1c0cffe88d9f407b93e61a9398a7f07a]) successfully deleted
I20260809 18:59:41.684203 8205 tablet_replica.cc:330] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: stopping tablet replica
I20260809 18:59:41.684700 8205 raft_consensus.cc:2229] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:59:41.685235 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 7525
I20260809 18:59:41.685272 8205 raft_consensus.cc:2258] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 18:59:41.726114 7449 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.188.193:36011 (error 108)
I20260809 18:59:41.726589 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 7749
I20260809 18:59:41.728629 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.727967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59634)
0809 18:59:41.728373 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.728478 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":212,"threads_started":1}
W20260809 18:59:41.728920 7449 catalog_manager.cc:4584] TS 188ca871512f4ee2895c3b16ed2af686 (127.16.188.193:36011): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0901b7266eee4955989a5dffa0caf999: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
I20260809 18:59:41.746645 8156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.727678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57354 (local address 127.16.188.194:37827)
0809 18:59:41.727873 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.727879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.727900 (+ 21us) server_negotiation.cc:407] Connection header received
0809 18:59:41.727959 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.727964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.728037 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.728130 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:41.730018 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.730828 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.732606 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.733045 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.733185 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.740838 (+ 7653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:41.740849 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:41.740863 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:41.740903 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:41.743863 (+ 2960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.744594 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.744611 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.744613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.744752 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.745136 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.745141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.745143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.745497 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:41.745805 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.746089 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.746297 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:59:41.747284 7934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:41.782582 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.782058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59642)
0809 18:59:41.782283 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.782411 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 18:59:41.783684 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.783228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59648)
0809 18:59:41.783393 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.783480 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 18:59:41.845419 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.844790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59664)
0809 18:59:41.845125 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.845236 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260809 18:59:41.846612 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.846168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59670)
0809 18:59:41.846367 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.846449 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 18:59:41.868476 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 7749
I20260809 18:59:41.895479 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 7947
I20260809 18:59:41.908418 8210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.896239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40258 (local address 127.16.188.195:40205)
0809 18:59:41.896747 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:41.896754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:41.896786 (+ 32us) server_negotiation.cc:407] Connection header received
0809 18:59:41.896857 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:41.896861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:41.896954 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:41.897073 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:41.898714 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.899559 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.900813 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:41.901218 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:41.901312 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:41.903721 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:41.903736 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:41.903752 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:41.903796 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:41.906182 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.906800 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.906806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.906809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.906927 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:41.907203 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:41.907206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:41.907208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:41.907527 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:41.907738 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:41.907966 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 18:59:41.908121 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":244,"threads_started":1}
I20260809 18:59:41.909021 8130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:41.927228 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.926777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59684)
0809 18:59:41.926982 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.927070 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 18:59:41.928308 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:41.927894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59692)
0809 18:59:41.928097 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:41.928168 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260809 18:59:41.996027 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 7947
I20260809 18:59:42.020695 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 7422
I20260809 18:59:42.021925 7514 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:42.134979 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:42.134491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:36011 (local address 127.0.0.1:59702)
0809 18:59:42.134687 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:42.134819 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:36011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 18:59:42.135046 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 7422
I20260809 18:59:42.165077 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40467
--webserver_interface=127.16.188.254
--webserver_port=39473
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:40467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:59:42.497556 8216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:42.497835 8216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:42.497934 8216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:42.504945 8216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:59:42.505043 8216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:42.505119 8216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:42.505198 8216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:59:42.505242 8216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:59:42.514549 8216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:40467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=39473
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:42.515671 8216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:42.516851 8216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:42.527813 8222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:42.527853 8226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:42.527904 8224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:42.528851 8216 server_base.cc:1034] running on GCE node
I20260809 18:59:42.529603 8216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:42.530856 8216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:42.532047 8216 hybrid_clock.cc:648] HybridClock initialized: now 1786301982531999 us; error 38 us; skew 500 ppm
I20260809 18:59:42.532357 8216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:42 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301982, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:42.535202 8216 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 18:59:42.536530 8216 webserver.cc:460] Webserver started at http://127.16.188.254:39473/ using document root <none> and password file <none>
I20260809 18:59:42.537200 8216 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:42.537322 8216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:42.542558 8216 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 18:59:42.545262 8235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:42.546486 8216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 18:59:42.546649 8216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "5265e67decf54a9b9449e1fab8894375"
format_stamp: "Formatted at 2026-08-09 18:59:35 on dist-test-slave-266d"
server_key: "2e65e3fc82444e640047edd011d98ef6"
server_key_iv: "684fc4a2a9989f40abcdf03478387801"
server_key_version: "encryptionkey@0"
I20260809 18:59:42.547581 8216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:42.578258 8216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:42.582063 8216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:42.582309 8216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:42.599692 8216 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:40467
I20260809 18:59:42.599737 8311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:40467 every 8 connection(s)
I20260809 18:59:42.601153 8216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 18:59:42.607997 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 8216
I20260809 18:59:42.608074 8312 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:59:42.608810 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:36011
--local_ip_for_outbound_sockets=127.16.188.193
--tserver_master_addrs=127.16.188.254:40467
--webserver_port=43243
--webserver_interface=127.16.188.193
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:42.611409 8312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Bootstrap starting.
I20260809 18:59:42.631251 8312 log.cc:824] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:42.647538 8312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:42.648023 8312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375: Bootstrap complete.
I20260809 18:59:42.657394 8312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:42.658234 8312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5265e67decf54a9b9449e1fab8894375, State: Initialized, Role: FOLLOWER
I20260809 18:59:42.658831 8312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:42.659047 8312 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:59:42.659171 8312 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:59:42.659334 8312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 2 FOLLOWER]: Advancing to term 3
I20260809 18:59:42.663053 8312 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:42.663538 8312 leader_election.cc:302] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5265e67decf54a9b9449e1fab8894375; no voters:
I20260809 18:59:42.664135 8312 leader_election.cc:288] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 18:59:42.664269 8317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 18:59:42.665385 8317 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [term 3 LEADER]: Becoming Leader. State: Replica: 5265e67decf54a9b9449e1fab8894375, State: Running, Role: LEADER
I20260809 18:59:42.665980 8317 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } }
I20260809 18:59:42.666254 8312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:59:42.668598 8318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "5265e67decf54a9b9449e1fab8894375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } } }
I20260809 18:59:42.668603 8319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5265e67decf54a9b9449e1fab8894375. Latest consensus state: current_term: 3 leader_uuid: "5265e67decf54a9b9449e1fab8894375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5265e67decf54a9b9449e1fab8894375" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40467 } } }
I20260809 18:59:42.669009 8319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:42.669013 8318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5265e67decf54a9b9449e1fab8894375 [sys.catalog]: This master's current role is: LEADER
I20260809 18:59:42.672102 8327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:59:42.680720 8327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:59:42.682235 8327 catalog_manager.cc:1259] Loaded cluster ID: e61b64365d624fd5b6d003904a42a7e6
I20260809 18:59:42.682380 8327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 18:59:42.684502 8327 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6d6a01e9ad google::LogMessage::Fail() at ??:0
@ 0x7f6d6a02188a google::LogMessage::SendToLog() at ??:0
@ 0x7f6d6a01e4de google::LogMessage::Flush() at ??:0
@ 0x7f6d6a01fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6d7fa51512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f6d7fa4e976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6d7fad6610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f6d7fad6439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6d6cc6a345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6d6cc6d91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f6d6cc6d799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6d6cc48eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6d6ff226db start_thread at ??:0
@ 0x7f6d68eb861f clone at ??:0
W20260809 18:59:42.959503 8314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:42.959772 8314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:42.959890 8314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:42.966912 8314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:42.967021 8314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:42.967170 8314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 18:59:42.976528 8314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:36011
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=43243
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:42.977736 8314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:42.979002 8314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:42.991530 8376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:42.991570 8380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:42.991503 8377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:42.992168 8314 server_base.cc:1034] running on GCE node
I20260809 18:59:42.992735 8314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:42.993639 8314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:42.994822 8314 hybrid_clock.cc:648] HybridClock initialized: now 1786301982994776 us; error 43 us; skew 500 ppm
I20260809 18:59:42.995070 8314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:42 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301982, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:42.997956 8314 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 18:59:42.999267 8314 webserver.cc:460] Webserver started at http://127.16.188.193:43243/ using document root <none> and password file <none>
I20260809 18:59:42.999881 8314 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:42.999984 8314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:43.005059 8314 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 18:59:43.007836 8392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:43.009063 8314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:43.009231 8314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "188ca871512f4ee2895c3b16ed2af686"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "56d301c61bf43e56c630769e0e8a6965"
server_key_iv: "6748705cc43846e52da831cacfbee805"
server_key_version: "encryptionkey@0"
I20260809 18:59:43.010138 8314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:43.040712 8314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:43.044842 8314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:43.045074 8314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:43.046017 8314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:43.047693 8404 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260809 18:59:43.053043 8314 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 18:59:43.053198 8314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260809 18:59:43.053295 8314 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 18:59:43.056504 8314 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 18:59:43.056577 8314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260809 18:59:43.056891 8404 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Bootstrap starting.
I20260809 18:59:43.083428 8404 log.cc:824] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Log is configured to *not* fsync() on all Append() calls
I20260809 18:59:43.091847 8314 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:36011
I20260809 18:59:43.091882 8577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:36011 every 8 connection(s)
I20260809 18:59:43.093168 8314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 18:59:43.094532 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 8314
I20260809 18:59:43.095135 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:37827
--local_ip_for_outbound_sockets=127.16.188.194
--tserver_master_addrs=127.16.188.254:40467
--webserver_port=42119
--webserver_interface=127.16.188.194
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:43.095642 8404 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:59:43.098182 8404 tablet_bootstrap.cc:492] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Bootstrap complete.
I20260809 18:59:43.099457 8404 ts_tablet_manager.cc:1397] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Time spent bootstrapping tablet: real 0.043s user 0.026s sys 0.012s
I20260809 18:59:43.103282 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.099514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:45011)
0809 18:59:43.101743 (+ 2229us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.102086 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1933,"thread_start_us":1690,"threads_started":1}
W20260809 18:59:43.104074 8578 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:40467 (0 consecutive failures): Network error: Failed to ping master at 127.16.188.254:40467: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
I20260809 18:59:43.105048 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.104663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:53725)
0809 18:59:43.104824 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.104911 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 18:59:43.106458 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.105630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:55039)
0809 18:59:43.106166 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.106259 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":254,"threads_started":1}
W20260809 18:59:43.106650 8578 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:59:43.108196 8404 raft_consensus.cc:348] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:43.109356 8404 raft_consensus.cc:729] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 188ca871512f4ee2895c3b16ed2af686, State: Initialized, Role: FOLLOWER
I20260809 18:59:43.109998 8404 consensus_queue.cc:260] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:43.111372 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.111069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:37399)
0809 18:59:43.111203 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.111268 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 18:59:43.111562 8404 ts_tablet_manager.cc:1428] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686: Time spent starting tablet: real 0.012s user 0.004s sys 0.009s
I20260809 18:59:43.112419 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.112119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:54757)
0809 18:59:43.112250 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.112308 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 18:59:43.426666 8582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:43.426929 8582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:43.427048 8582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:43.433984 8582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:43.434079 8582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:43.434213 8582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 18:59:43.443626 8582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:37827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=42119
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:43.444854 8582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:43.446133 8582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:43.458447 8591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:43.458498 8592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:43.458532 8596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:43.459333 8582 server_base.cc:1034] running on GCE node
I20260809 18:59:43.459913 8582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:43.460803 8582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:43.462003 8582 hybrid_clock.cc:648] HybridClock initialized: now 1786301983461956 us; error 35 us; skew 500 ppm
I20260809 18:59:43.462296 8582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:43 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301983, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:43.465303 8582 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 18:59:43.466616 8582 webserver.cc:460] Webserver started at http://127.16.188.194:42119/ using document root <none> and password file <none>
I20260809 18:59:43.467245 8582 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:43.467362 8582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:43.472380 8582 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 18:59:43.474984 8608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:43.476174 8582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:59:43.476333 8582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "df28bcd3fcba490c8859aa742e55ab00"
format_stamp: "Formatted at 2026-08-09 18:59:36 on dist-test-slave-266d"
server_key: "5b80805db79da73c2810d49ac4881c65"
server_key_iv: "0a771bfc1280f734f5988ac0d6e4fd18"
server_key_version: "encryptionkey@0"
I20260809 18:59:43.477300 8582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:43.491431 8582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:43.495395 8582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:43.495644 8582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:43.496577 8582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:43.497889 8582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:43.497978 8582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:43.498081 8582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:43.498162 8582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:43.527417 8582 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:37827
I20260809 18:59:43.527474 8775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:37827 every 8 connection(s)
I20260809 18:59:43.528824 8582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 18:59:43.532855 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 8582
I20260809 18:59:43.533658 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:40205
--local_ip_for_outbound_sockets=127.16.188.195
--tserver_master_addrs=127.16.188.254:40467
--webserver_port=34545
--webserver_interface=127.16.188.195
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:59:43.533906 8778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.531686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:50931)
0809 18:59:43.532431 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.532710 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":273,"threads_started":1}
W20260809 18:59:43.534566 8776 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:40467 (0 consecutive failures): Network error: Failed to ping master at 127.16.188.254:40467: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
I20260809 18:59:43.535403 8778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.535025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:59477)
0809 18:59:43.535194 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.535278 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 18:59:43.536250 8778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.535905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:59309)
0809 18:59:43.536035 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.536129 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 18:59:43.536521 8776 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:59:43.864506 8779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:59:43.864784 8779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:59:43.864878 8779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:59:43.871968 8779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:59:43.872076 8779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:59:43.872188 8779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 18:59:43.881882 8779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:40205
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=34545
--tserver_master_addrs=127.16.188.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 18:59:43.883107 8779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:59:43.884366 8779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:59:43.896898 8787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:43.896984 8786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:59:43.896807 8789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:59:43.897855 8779 server_base.cc:1034] running on GCE node
I20260809 18:59:43.898396 8779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:59:43.899307 8779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:59:43.900490 8779 hybrid_clock.cc:648] HybridClock initialized: now 1786301983900425 us; error 55 us; skew 500 ppm
I20260809 18:59:43.900804 8779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 18:59:43 dist-test-slave-266d krb5kdc[6552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301983, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:59:43.903770 8779 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 18:59:43.905030 8779 webserver.cc:460] Webserver started at http://127.16.188.195:34545/ using document root <none> and password file <none>
I20260809 18:59:43.905682 8779 fs_manager.cc:359] Metadata directory not provided
I20260809 18:59:43.905782 8779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:59:43.910712 8779 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 18:59:43.913211 8803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:43.914510 8779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 18:59:43.914666 8779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "a226797d4446412e8e6b6a1ea4d068c9"
format_stamp: "Formatted at 2026-08-09 18:59:37 on dist-test-slave-266d"
server_key: "a693ca3022c5ea18101400625de7ba36"
server_key_iv: "a5c418f1749f504851d8cd0c7853a964"
server_key_version: "encryptionkey@0"
I20260809 18:59:43.915568 8779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:59:43.945675 8779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:59:43.949787 8779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:59:43.950040 8779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:59:43.950994 8779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:59:43.952282 8779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:59:43.952373 8779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:43.952479 8779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:59:43.952549 8779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:59:43.984897 8779 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:40205
I20260809 18:59:43.985008 8977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:40205 every 8 connection(s)
I20260809 18:59:43.986338 8779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 18:59:43.990202 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 8779
I20260809 18:59:43.991242 8983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.989172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:43705)
0809 18:59:43.989950 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.990233 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":266,"threads_started":1}
W20260809 18:59:43.991958 8979 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:40467 (0 consecutive failures): Network error: Failed to ping master at 127.16.188.254:40467: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
I20260809 18:59:43.992734 8983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.992387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:43467)
0809 18:59:43.992550 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.992625 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 18:59:43.993564 8983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:43.993246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:57207)
0809 18:59:43.993379 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:43.993454 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 18:59:43.993780 8979 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:59:44.113878 8986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:44.113172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:36329)
0809 18:59:44.113598 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:44.113679 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":209,"threads_started":1}
I20260809 18:59:44.510215 8987 raft_consensus.cc:482] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:44.510492 8987 raft_consensus.cc:504] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:44.514231 8987 leader_election.cc:288] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827), a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205)
Aug 09 18:59:44 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301982, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
Aug 09 18:59:44 dist-test-slave-266d krb5kdc[6552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301982, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 18:59:44.534538 8986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:44.512471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:37827 (local address 127.16.188.193:35747)
0809 18:59:44.512787 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:44.512835 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:44.513432 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:44.517219 (+ 3787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:44.517223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:44.517880 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:44.518595 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:44.518616 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:44.520168 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:44.520172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:44.522301 (+ 2129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:44.522315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:44.524190 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:44.524196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:44.524355 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:44.524918 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:44.524940 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:44.527090 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:44.531331 (+ 4241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:44.531337 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:44.531341 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:44.531797 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:44.532291 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:44.532296 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:44.532299 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:44.532462 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:44.533418 (+ 956us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:44.533422 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:44.533554 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 18:59:44.533670 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 18:59:44.534206 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":404,"spinlock_wait_cycles":9984}
I20260809 18:59:44.534775 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:44.512658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:35747 (local address 127.16.188.194:37827)
0809 18:59:44.514847 (+ 2189us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:44.514857 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:44.514888 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:59:44.516331 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:44.516340 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:44.516655 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:44.516940 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:44.518774 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:44.519961 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:44.523410 (+ 3449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:44.524001 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:44.524117 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:44.527399 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:44.527410 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:44.527424 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:44.527466 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:44.531211 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:44.531943 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:44.531952 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:44.531959 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:44.532153 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:44.532599 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:44.532604 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:44.532607 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:44.533283 (+ 676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:44.533468 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:44.534019 (+ 551us) server_negotiation.cc:299] Negotiation successful
0809 18:59:44.534387 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2032,"thread_start_us":1909,"threads_started":1}
I20260809 18:59:44.534590 8988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:44.512637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:40205 (local address 127.16.188.193:39527)
0809 18:59:44.514234 (+ 1597us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:44.514252 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:59:44.514375 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:59:44.517078 (+ 2703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:59:44.517128 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:59:44.517881 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:59:44.518596 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:44.518617 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:44.520167 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:44.520172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:44.522300 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:59:44.522315 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:59:44.523273 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:59:44.523278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:59:44.523454 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:44.524099 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:59:44.524130 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:59:44.526696 (+ 2566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:59:44.530846 (+ 4150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:44.530855 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:44.530868 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:44.531450 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:44.531955 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:59:44.531960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:59:44.531964 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:59:44.532147 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:59:44.532999 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:59:44.533004 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:59:44.533304 (+ 300us) client_negotiation.cc:769] Sending connection context
0809 18:59:44.533613 (+ 309us) client_negotiation.cc:240] Negotiation successful
0809 18:59:44.534109 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1461,"mutex_wait_us":159,"spinlock_wait_cycles":15616,"thread_start_us":1287,"threads_started":1}
I20260809 18:59:44.535470 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:44.512693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:39527 (local address 127.16.188.195:40205)
0809 18:59:44.514865 (+ 2172us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:44.514876 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:44.514907 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:59:44.516280 (+ 1373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:44.516290 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:44.516648 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:44.516894 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:44.518782 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:44.519962 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:44.522431 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:44.523094 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:44.523235 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:44.526982 (+ 3747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:44.526993 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:44.527009 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:44.527053 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:44.530699 (+ 3646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:44.531598 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:44.531616 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:44.531623 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:44.531827 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:44.532262 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:44.532267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:44.532271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:44.532865 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:44.533051 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:44.534747 (+ 1696us) server_negotiation.cc:299] Negotiation successful
0809 18:59:44.535139 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2025,"thread_start_us":1937,"threads_started":1}
I20260809 18:59:44.537817 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:44.536967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:38953)
0809 18:59:44.537490 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:44.537622 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":268,"threads_started":1}
W20260809 18:59:44.538546 8399 leader_election.cc:341] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827): Not found: Tablet not found: 0901b7266eee4955989a5dffa0caf999
W20260809 18:59:44.538830 8398 leader_election.cc:341] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205): Not found: Tablet not found: 0901b7266eee4955989a5dffa0caf999
I20260809 18:59:44.538991 8398 leader_election.cc:302] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 188ca871512f4ee2895c3b16ed2af686; no voters: a226797d4446412e8e6b6a1ea4d068c9, df28bcd3fcba490c8859aa742e55ab00
I20260809 18:59:44.539356 8987 raft_consensus.cc:2726] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:44.995072 8997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:44.994257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:52761)
0809 18:59:44.994679 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:44.994841 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":198,"threads_started":1}
I20260809 18:59:45.115294 8998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:45.114648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:44495)
0809 18:59:45.115049 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:45.115131 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":203,"threads_started":1}
I20260809 18:59:45.539487 8999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:45.538719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:43803)
0809 18:59:45.539235 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:45.539326 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":281,"threads_started":1}
I20260809 18:59:45.996616 9000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:45.995842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:41157)
0809 18:59:45.996335 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:45.996426 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":256,"threads_started":1}
I20260809 18:59:46.116814 9002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:46.116032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:45425)
0809 18:59:46.116529 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:46.116623 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":239,"threads_started":1}
I20260809 18:59:46.373020 9003 raft_consensus.cc:482] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:46.373298 9003 raft_consensus.cc:504] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:46.373941 9003 leader_election.cc:288] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827), a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205)
W20260809 18:59:46.374878 8399 leader_election.cc:341] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827): Not found: Tablet not found: 0901b7266eee4955989a5dffa0caf999
W20260809 18:59:46.375058 8398 leader_election.cc:341] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205): Not found: Tablet not found: 0901b7266eee4955989a5dffa0caf999
I20260809 18:59:46.375187 8398 leader_election.cc:302] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 188ca871512f4ee2895c3b16ed2af686; no voters: a226797d4446412e8e6b6a1ea4d068c9, df28bcd3fcba490c8859aa742e55ab00
I20260809 18:59:46.375432 9003 raft_consensus.cc:2726] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:46.541033 9006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:46.540354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:33599)
0809 18:59:46.540790 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:46.540870 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":236,"threads_started":1}
I20260809 18:59:46.998247 9009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:46.997547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:56289)
0809 18:59:46.998001 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:46.998084 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":241,"threads_started":1}
I20260809 18:59:47.118498 9011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:47.117661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:45863)
0809 18:59:47.118172 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:47.118277 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":260,"threads_started":1}
I20260809 18:59:47.542569 9012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:47.541891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:33709)
0809 18:59:47.542324 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:47.542399 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":208,"threads_started":1}
I20260809 18:59:47.999702 9013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:47.999037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:44133)
0809 18:59:47.999451 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:47.999530 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":208,"threads_started":1}
I20260809 18:59:48.120355 9015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:48.119556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:40531)
0809 18:59:48.120095 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:48.120174 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":326,"threads_started":1}
I20260809 18:59:48.544128 9016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:48.543430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:35531)
0809 18:59:48.543866 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:48.543956 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":233,"threads_started":1}
I20260809 18:59:49.001235 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:49.000509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:32969)
0809 18:59:49.000967 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:49.001046 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":235,"threads_started":1}
I20260809 18:59:49.121865 9021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:49.121136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:39951)
0809 18:59:49.121610 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:49.121697 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":244,"threads_started":1}
I20260809 18:59:49.545724 9022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:49.544900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:53595)
0809 18:59:49.545435 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:49.545525 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":288,"threads_started":1}
I20260809 18:59:49.723040 9023 raft_consensus.cc:482] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:49.723277 9023 raft_consensus.cc:504] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:49.723973 9023 leader_election.cc:288] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827), a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205)
W20260809 18:59:49.724936 8399 leader_election.cc:341] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827): Not found: Tablet not found: 0901b7266eee4955989a5dffa0caf999
W20260809 18:59:49.725154 8398 leader_election.cc:341] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205): Not found: Tablet not found: 0901b7266eee4955989a5dffa0caf999
I20260809 18:59:49.725275 8398 leader_election.cc:302] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 188ca871512f4ee2895c3b16ed2af686; no voters: a226797d4446412e8e6b6a1ea4d068c9, df28bcd3fcba490c8859aa742e55ab00
I20260809 18:59:49.725522 9023 raft_consensus.cc:2726] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:50.002702 9025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:50.002031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:54225)
0809 18:59:50.002447 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:50.002528 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":219,"threads_started":1}
I20260809 18:59:50.123385 9029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:50.122648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:37801)
0809 18:59:50.123110 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:50.123196 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":238,"threads_started":1}
I20260809 18:59:50.547353 9030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:50.546596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:42173)
0809 18:59:50.547075 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:50.547155 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":217,"threads_started":1}
I20260809 18:59:51.004303 9031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:51.003497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:58751)
0809 18:59:51.004013 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:51.004099 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":237,"threads_started":1}
I20260809 18:59:51.124882 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:51.124138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:36701)
0809 18:59:51.124611 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:51.124712 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":246,"threads_started":1}
I20260809 18:59:51.548893 9033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:51.548229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:55361)
0809 18:59:51.548637 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:51.548717 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":206,"threads_started":1}
I20260809 18:59:52.005784 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:52.005140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:55305)
0809 18:59:52.005528 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:52.005606 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":191,"threads_started":1}
I20260809 18:59:52.126477 9035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:52.125739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:43673)
0809 18:59:52.126213 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:52.126300 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":248,"threads_started":1}
I20260809 18:59:52.550468 9038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:52.549750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:45765)
0809 18:59:52.550202 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:52.550314 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":206,"threads_started":1}
I20260809 18:59:52.603502 9039 raft_consensus.cc:482] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:59:52.603730 9039 raft_consensus.cc:504] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df28bcd3fcba490c8859aa742e55ab00" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 37827 } } peers { permanent_uuid: "188ca871512f4ee2895c3b16ed2af686" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 36011 } } peers { permanent_uuid: "a226797d4446412e8e6b6a1ea4d068c9" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40205 } }
I20260809 18:59:52.604545 9039 leader_election.cc:288] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827), a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205)
W20260809 18:59:52.605491 8399 leader_election.cc:341] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer df28bcd3fcba490c8859aa742e55ab00 (127.16.188.194:37827): Not found: Tablet not found: 0901b7266eee4955989a5dffa0caf999
W20260809 18:59:52.605662 8398 leader_election.cc:341] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a226797d4446412e8e6b6a1ea4d068c9 (127.16.188.195:40205): Not found: Tablet not found: 0901b7266eee4955989a5dffa0caf999
I20260809 18:59:52.605798 8398 leader_election.cc:302] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 188ca871512f4ee2895c3b16ed2af686; no voters: a226797d4446412e8e6b6a1ea4d068c9, df28bcd3fcba490c8859aa742e55ab00
I20260809 18:59:52.606046 9039 raft_consensus.cc:2726] T 0901b7266eee4955989a5dffa0caf999 P 188ca871512f4ee2895c3b16ed2af686 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:59:53.007259 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:53.006546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:60755)
0809 18:59:53.007007 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:53.007096 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":230,"threads_started":1}
I20260809 18:59:53.128167 9041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:53.127458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:40379)
0809 18:59:53.127912 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:53.127998 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":248,"threads_started":1}
I20260809 18:59:53.552090 9042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:53.551330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:57133)
0809 18:59:53.551833 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:53.551911 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":256,"threads_started":1}
I20260809 18:59:54.008746 9043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.008046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:35087)
0809 18:59:54.008472 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.008555 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":216,"threads_started":1}
I20260809 18:59:54.129789 9048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.129020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:53293)
0809 18:59:54.129507 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.129589 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":275,"threads_started":1}
I20260809 18:59:54.553648 9049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:54.552874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:49957)
0809 18:59:54.553390 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:54.553474 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":271,"threads_started":1}
I20260809 18:59:55.010318 9050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.009549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:36509)
0809 18:59:55.010032 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:55.010146 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":244,"threads_started":1}
I20260809 18:59:55.131239 9051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.130533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:51627)
0809 18:59:55.130979 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:55.131059 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":236,"threads_started":1}
I20260809 18:59:55.555176 9054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:55.554499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:51453)
0809 18:59:55.554923 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:55.555010 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":221,"threads_started":1}
I20260809 18:59:56.012063 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:56.011244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:53001)
0809 18:59:56.011780 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:56.011872 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":263,"threads_started":1}
I20260809 18:59:56.132774 9056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:56.132053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:43695)
0809 18:59:56.132482 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:56.132580 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":214,"threads_started":1}
I20260809 18:59:56.556790 9059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:56.555986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:37305)
0809 18:59:56.556504 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:56.556615 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":252,"threads_started":1}
I20260809 18:59:57.013886 9065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:57.013137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:55127)
0809 18:59:57.013587 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:57.013684 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":227,"threads_started":1}
I20260809 18:59:57.134256 9067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:57.133573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:49921)
0809 18:59:57.133997 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:57.134080 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":229,"threads_started":1}
I20260809 18:59:57.558383 9069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:57.557593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:55947)
0809 18:59:57.558096 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:57.558184 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":245,"threads_started":1}
I20260809 18:59:58.015591 9070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:58.014813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:44515)
0809 18:59:58.015302 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:58.015394 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":278,"threads_started":1}
I20260809 18:59:58.136104 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:58.135408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.193:48951)
0809 18:59:58.135843 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:58.135932 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":238,"threads_started":1}
I20260809 18:59:58.560096 9073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:58.559400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.194:41125)
0809 18:59:58.559824 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:58.559941 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":201,"threads_started":1}
I20260809 18:59:58.997604 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 8314
I20260809 18:59:59.016448 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:58.998808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59650 (local address 127.16.188.193:36011)
0809 18:59:58.999432 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:58.999442 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:58.999473 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:59:58.999552 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:58.999562 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:58.999843 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:59.000006 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:59.001924 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:59.002886 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:59.004013 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:59.004551 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:59.004655 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:59.011375 (+ 6720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:59.011386 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:59.011400 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:59.011432 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:59.014055 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:59.014683 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:59.014689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:59.014691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:59.014817 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:59.015137 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:59.015140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:59.015141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:59.015459 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:59.015685 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:59.015884 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 18:59:59.016068 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":300,"threads_started":1}
I20260809 18:59:59.017426 9077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:59.016700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40467 (local address 127.16.188.195:59385)
0809 18:59:59.017181 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 18:59:59.017279 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:40467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":233,"threads_started":1}
I20260809 18:59:59.017884 8573 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:59.104602 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 8314
I20260809 18:59:59.132196 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 8582
I20260809 18:59:59.144306 9081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:59.132895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56012 (local address 127.16.188.194:37827)
0809 18:59:59.133489 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:59.133493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:59.133509 (+ 16us) server_negotiation.cc:407] Connection header received
0809 18:59:59.133569 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:59.133572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:59.133632 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:59.133722 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:59.135081 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:59.135870 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:59.137060 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:59.137514 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:59.137609 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:59.139904 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:59.139908 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:59.139912 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:59.139942 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:59.142312 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:59.142879 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:59.142882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:59.142884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:59.142995 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:59.143259 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:59.143261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:59.143263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:59.143501 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:59.143695 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:59.143876 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 18:59:59.144036 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":375,"threads_started":1}
I20260809 18:59:59.144984 8768 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:59.228107 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 8582
I20260809 18:59:59.254560 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 8779
I20260809 18:59:59.267829 9084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:59:59.255381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.16.188.195:40205)
0809 18:59:59.256025 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0809 18:59:59.256030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:59:59.256050 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:59:59.256114 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:59:59.256118 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:59:59.256183 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:59:59.256283 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:59:59.257692 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:59.258545 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:59.259723 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:59:59.260199 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:59:59.260306 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:59:59.262881 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:59:59.262886 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:59:59.262890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:59:59.262924 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:59:59.265600 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:59.266206 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:59.266210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:59.266212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:59.266362 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:59:59.266680 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:59:59.266684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:59:59.266687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:59:59.266950 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:59:59.267160 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 18:59:59.267351 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 18:59:59.267512 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":334,"threads_started":1}
I20260809 18:59:59.268491 8970 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 18:59:59.348982 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 8779
2026-08-09T18:59:59Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25556 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:59:59 dist-test-slave-266d krb5kdc[9094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:59:59 dist-test-slave-266d krb5kdc[9094](info): set up 2 sockets
Aug 09 18:59:59 dist-test-slave-266d krb5kdc[9094](info): commencing operation
krb5kdc: starting...
W20260809 19:00:00.550065 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.001s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:00:00 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:00:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:00:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:00:00.790155 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:37119
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:37119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:01.125571 9110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:01.125876 9110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:01.126010 9110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:01.133076 9110 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 19:00:01.133183 9110 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 19:00:01.133239 9110 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 19:00:01.133313 9110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:01.133388 9110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:01.133481 9110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:01.133543 9110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:01.133620 9110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:01.143183 9110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:37119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:37119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:01.144515 9110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:01.145843 9110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:01.157754 9122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:01.157872 9119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:01.157852 9120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:01.158499 9110 server_base.cc:1034] running on GCE node
I20260809 19:00:01.159256 9110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:01.160619 9110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:01.161859 9110 hybrid_clock.cc:648] HybridClock initialized: now 1786302001161790 us; error 25 us; skew 500 ppm
I20260809 19:00:01.162174 9110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:01 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302001, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:01.165299 9110 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:00:01.166708 9110 webserver.cc:460] Webserver started at http://127.16.188.254:46147/ using document root <none> and password file <none>
I20260809 19:00:01.167382 9110 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:01.167490 9110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:01.167786 9110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:01.170758 9110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "9fbf8c3d7bea4591842115458520485c"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "7f3041255daad660f1ed54081ef261c4"
server_key_iv: "89c63cd8e1d48ff2f9e3e8d9d5665592"
server_key_version: "encryptionkey@0"
I20260809 19:00:01.171531 9110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "9fbf8c3d7bea4591842115458520485c"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "7f3041255daad660f1ed54081ef261c4"
server_key_iv: "89c63cd8e1d48ff2f9e3e8d9d5665592"
server_key_version: "encryptionkey@0"
I20260809 19:00:01.176406 9110 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:00:01.179756 9130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:01.180984 9110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:00:01.181165 9110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "9fbf8c3d7bea4591842115458520485c"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "7f3041255daad660f1ed54081ef261c4"
server_key_iv: "89c63cd8e1d48ff2f9e3e8d9d5665592"
server_key_version: "encryptionkey@0"
I20260809 19:00:01.181365 9110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:01.198904 9110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:01.202994 9110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:01.203233 9110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:01.220670 9110 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:37119
I20260809 19:00:01.220690 9214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:37119 every 8 connection(s)
I20260809 19:00:01.221966 9110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:01.225502 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 9110
I20260809 19:00:01.225625 9215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:01.225718 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:00:01.226390 17139 external_mini_cluster.cc:1428] Setting key 551a6b0f7780fc4adbc77e2234d84bee
I20260809 19:00:01.238760 9215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Bootstrap starting.
Aug 09 19:00:01 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:00:01.241953 9215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:01.243085 9215 log.cc:824] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:01.246147 9215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: No bootstrap required, opened a new log
I20260809 19:00:01.249838 9221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:01.228269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46450 (local address 127.16.188.254:37119)
0809 19:00:01.229029 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:01.229040 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:01.229082 (+ 42us) server_negotiation.cc:407] Connection header received
0809 19:00:01.231309 (+ 2227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:01.231332 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:01.231686 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:01.232027 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:01.233826 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:01.235119 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:01.236979 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:01.237789 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:01.237980 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:01.242533 (+ 4553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:01.242540 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:01.242555 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:01.242595 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:01.245772 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:01.246482 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:01.246489 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:01.246495 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:01.246679 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:01.247083 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:01.247088 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:01.247091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:01.247613 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:01.247925 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:01.248393 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 19:00:01.248806 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":339,"threads_started":1}
I20260809 19:00:01.254294 9215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:01.254642 9215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:01.254750 9215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbf8c3d7bea4591842115458520485c, State: Initialized, Role: FOLLOWER
I20260809 19:00:01.255295 9215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:01.255537 9215 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:01.255689 9215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:01.255861 9215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:01.258387 9215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:01.258953 9215 leader_election.cc:302] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fbf8c3d7bea4591842115458520485c; no voters:
I20260809 19:00:01.259526 9215 leader_election.cc:288] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:00:01.259619 9225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:01.260291 9225 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 1 LEADER]: Becoming Leader. State: Replica: 9fbf8c3d7bea4591842115458520485c, State: Running, Role: LEADER
I20260809 19:00:01.260793 9225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:01.261626 9215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:01.263828 9226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fbf8c3d7bea4591842115458520485c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } } }
I20260809 19:00:01.263827 9227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fbf8c3d7bea4591842115458520485c. Latest consensus state: current_term: 1 leader_uuid: "9fbf8c3d7bea4591842115458520485c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } } }
I20260809 19:00:01.264320 9226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:01.264325 9227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:01.266582 9238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:01.271319 9238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:01.279757 9238 catalog_manager.cc:1347] Generated new cluster ID: 2262be319dfc4192826e99f220872ce6
I20260809 19:00:01.279940 9238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:01.311314 9238 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:00:01.312623 9238 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:01.325209 9238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Generated new TSK 0
I20260809 19:00:01.325999 9238 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 19:00:01.394009 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:37119
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:01.716579 9261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:01.716862 9261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:01.716956 9261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:01.723865 9261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:01.723981 9261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:01.724092 9261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:00:01.733577 9261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:01.734794 9261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:01.736012 9261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:01.748838 9269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:01.748770 9273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:01.748771 9270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:01.749706 9261 server_base.cc:1034] running on GCE node
I20260809 19:00:01.750238 9261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:01.751081 9261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:01.752305 9261 hybrid_clock.cc:648] HybridClock initialized: now 1786302001752253 us; error 47 us; skew 500 ppm
I20260809 19:00:01.752593 9261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:01 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302001, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:01.755580 9261 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 19:00:01.756912 9261 webserver.cc:460] Webserver started at http://127.16.188.193:37257/ using document root <none> and password file <none>
I20260809 19:00:01.757572 9261 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:01.757683 9261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:01.757963 9261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:01.760738 9261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "5eb8211b53c44b879d48d5555c067d96"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "52bbdc09936ab6d1ca20237bad500fe6"
server_key_iv: "742fa8cc5c4f221f300aea300bf608f7"
server_key_version: "encryptionkey@0"
I20260809 19:00:01.761505 9261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "5eb8211b53c44b879d48d5555c067d96"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "52bbdc09936ab6d1ca20237bad500fe6"
server_key_iv: "742fa8cc5c4f221f300aea300bf608f7"
server_key_version: "encryptionkey@0"
I20260809 19:00:01.766474 9261 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 19:00:01.769858 9286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:01.771068 9261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:00:01.771225 9261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "5eb8211b53c44b879d48d5555c067d96"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "52bbdc09936ab6d1ca20237bad500fe6"
server_key_iv: "742fa8cc5c4f221f300aea300bf608f7"
server_key_version: "encryptionkey@0"
I20260809 19:00:01.771406 9261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:01.785833 9261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:01.789528 9261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:01.789791 9261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:01.790689 9261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:01.791900 9261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:01.791980 9261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:01.792095 9261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:01.792160 9261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:01.820850 9261 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:40315
I20260809 19:00:01.820885 9464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:40315 every 8 connection(s)
I20260809 19:00:01.822109 9261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:01.828220 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 9261
I20260809 19:00:01.828466 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 19:00:01.829327 17139 external_mini_cluster.cc:1428] Setting key 7891f623b9409cfbe00a0951877a25cc
Aug 09 19:00:01 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302001, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:00:01.844684 9469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:01.824536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:59471 (local address 127.16.188.254:37119)
0809 19:00:01.825079 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:01.825109 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:01.826000 (+ 891us) server_negotiation.cc:407] Connection header received
0809 19:00:01.827768 (+ 1768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:01.827772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:01.827842 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:01.827934 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:01.829952 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:01.830990 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:01.833224 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:01.833662 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:01.833764 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:01.837730 (+ 3966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:01.837735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:01.837738 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:01.837770 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:01.841050 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:01.841958 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:01.841964 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:01.841967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:01.842173 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:01.842715 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:01.842720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:01.842723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:01.843113 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:01.843263 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:01.844042 (+ 779us) server_negotiation.cc:299] Negotiation successful
0809 19:00:01.844269 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":312,"threads_started":1}
I20260809 19:00:01.845705 9470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:01.825062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:59471)
0809 19:00:01.825843 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:01.825879 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:01.827525 (+ 1646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:01.828215 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:01.828226 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:01.828926 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:01.829756 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:01.829783 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:01.831169 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:01.831175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:01.833037 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:01.833053 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:01.833887 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:01.833894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:01.834175 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:01.834884 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:01.834911 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:01.837488 (+ 2577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:01.841233 (+ 3745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:01.841243 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:01.841259 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:01.841812 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:01.842296 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:01.842318 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:01.842321 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:01.842573 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:01.843267 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:01.843277 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:01.843657 (+ 380us) client_negotiation.cc:769] Sending connection context
0809 19:00:01.843891 (+ 234us) client_negotiation.cc:240] Negotiation successful
0809 19:00:01.844434 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":283,"threads_started":1}
I20260809 19:00:01.847326 9465 heartbeater.cc:347] Connected to a master server at 127.16.188.254:37119
I20260809 19:00:01.847649 9465 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:01.848483 9465 heartbeater.cc:511] Master 127.16.188.254:37119 requested a full tablet report, sending...
I20260809 19:00:01.850934 9158 ts_manager.cc:194] Registered new tserver with Master: 5eb8211b53c44b879d48d5555c067d96 (127.16.188.193:40315)
I20260809 19:00:01.852458 9158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:59471
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 19:00:01.893788 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:37119
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:02.241201 9474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:02.241518 9474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:02.241670 9474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:02.248991 9474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:02.249152 9474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:02.249323 9474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:00:02.259195 9474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:02.260492 9474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:02.261900 9474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:02.275063 9484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:02.275243 9482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:02.275331 9487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:02.275920 9474 server_base.cc:1034] running on GCE node
I20260809 19:00:02.276486 9474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:02.277386 9474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:02.278586 9474 hybrid_clock.cc:648] HybridClock initialized: now 1786302002278536 us; error 40 us; skew 500 ppm
I20260809 19:00:02.278883 9474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:02 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302002, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:02.281844 9474 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 19:00:02.283243 9474 webserver.cc:460] Webserver started at http://127.16.188.194:34977/ using document root <none> and password file <none>
I20260809 19:00:02.283895 9474 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:02.284010 9474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:02.284291 9474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:02.287147 9474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "005e317c1c8f97c22afb11ae0b4344d2"
server_key_iv: "95079513cf176c09fc48885136121bfe"
server_key_version: "encryptionkey@0"
I20260809 19:00:02.287869 9474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "005e317c1c8f97c22afb11ae0b4344d2"
server_key_iv: "95079513cf176c09fc48885136121bfe"
server_key_version: "encryptionkey@0"
I20260809 19:00:02.292649 9474 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:00:02.295837 9495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:02.297032 9474 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 19:00:02.297235 9474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "005e317c1c8f97c22afb11ae0b4344d2"
server_key_iv: "95079513cf176c09fc48885136121bfe"
server_key_version: "encryptionkey@0"
I20260809 19:00:02.297413 9474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:02.309978 9474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:02.313824 9474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:02.314070 9474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:02.314913 9474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:02.316112 9474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:02.316190 9474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:02.316321 9474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:02.316380 9474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:02.346576 9474 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:34199
I20260809 19:00:02.346596 9674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:34199 every 8 connection(s)
I20260809 19:00:02.347867 9474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:00:02.349977 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 9474
I20260809 19:00:02.350153 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 19:00:02.350623 17139 external_mini_cluster.cc:1428] Setting key 2a741b5636a5bde800d13b8421696ef8
Aug 09 19:00:02 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302002, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:00:02.368721 9681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.350371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:39757 (local address 127.16.188.254:37119)
0809 19:00:02.350942 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:02.350948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:02.351862 (+ 914us) server_negotiation.cc:407] Connection header received
0809 19:00:02.353758 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:02.353763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:02.353843 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:02.353967 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:02.355557 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.356525 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.358144 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.358704 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.358825 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.362834 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:02.362839 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:02.362844 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:02.362883 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:02.365613 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:02.366411 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:02.366417 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:02.366420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:02.366577 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:02.367031 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:02.367036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:02.367039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:02.367317 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:02.367436 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:02.368285 (+ 849us) server_negotiation.cc:299] Negotiation successful
0809 19:00:02.368448 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":236,"threads_started":1}
I20260809 19:00:02.370080 9684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.350900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:39757)
0809 19:00:02.351690 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:02.351738 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:02.353486 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:02.354241 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:02.354254 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:02.354824 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:02.355391 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.355408 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.356702 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.356707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.358004 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.358018 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.358884 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.358889 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.359083 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.359799 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:02.359828 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:02.362616 (+ 2788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:02.365749 (+ 3133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:02.365758 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:02.365774 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:02.366304 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:02.366672 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:02.366677 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:02.366681 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:02.366916 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:02.367440 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:02.367448 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:02.367873 (+ 425us) client_negotiation.cc:769] Sending connection context
0809 19:00:02.368207 (+ 334us) client_negotiation.cc:240] Negotiation successful
0809 19:00:02.368706 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":319,"threads_started":1}
I20260809 19:00:02.371528 9677 heartbeater.cc:347] Connected to a master server at 127.16.188.254:37119
I20260809 19:00:02.371840 9677 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:02.372542 9677 heartbeater.cc:511] Master 127.16.188.254:37119 requested a full tablet report, sending...
I20260809 19:00:02.374006 9158 ts_manager.cc:194] Registered new tserver with Master: bb7837a3630f4a379e1b5d5bc2e10f6e (127.16.188.194:34199)
I20260809 19:00:02.375118 9158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:39757
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 19:00:02.413476 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:37119
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:02.742857 9689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:02.743126 9689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:02.743257 9689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:02.750168 9689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:02.750267 9689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:02.750416 9689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:00:02.759910 9689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:02.761188 9689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:02.762481 9689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:02.775132 9696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:02.775208 9695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:02.775153 9699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:02.776018 9689 server_base.cc:1034] running on GCE node
I20260809 19:00:02.776589 9689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:02.777511 9689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:02.778712 9689 hybrid_clock.cc:648] HybridClock initialized: now 1786302002778661 us; error 39 us; skew 500 ppm
I20260809 19:00:02.779000 9689 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:02 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302002, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:02.782001 9689 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 19:00:02.783406 9689 webserver.cc:460] Webserver started at http://127.16.188.195:44763/ using document root <none> and password file <none>
I20260809 19:00:02.784034 9689 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:02.784160 9689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:02.784451 9689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:00:02.787317 9689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "8f4df408d4b9ac118babd444306f911a"
server_key_iv: "89a2515a9d326c88053b4d702c7ccd89"
server_key_version: "encryptionkey@0"
I20260809 19:00:02.788023 9689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "8f4df408d4b9ac118babd444306f911a"
server_key_iv: "89a2515a9d326c88053b4d702c7ccd89"
server_key_version: "encryptionkey@0"
I20260809 19:00:02.792743 9689 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260809 19:00:02.795969 9714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:02.797231 9689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 19:00:02.797379 9689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "8f4df408d4b9ac118babd444306f911a"
server_key_iv: "89a2515a9d326c88053b4d702c7ccd89"
server_key_version: "encryptionkey@0"
I20260809 19:00:02.797545 9689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:02.830287 9689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:02.833858 9689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:02.834125 9689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:02.835021 9689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:02.836282 9689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:02.836374 9689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:02.836500 9689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:02.836553 9689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:02.855978 9465 heartbeater.cc:503] Master 127.16.188.254:37119 was elected leader, sending a full tablet report...
I20260809 19:00:02.866748 9689 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:41809
I20260809 19:00:02.866791 9900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:41809 every 8 connection(s)
I20260809 19:00:02.867983 9689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:00:02.874697 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 9689
I20260809 19:00:02.874872 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 19:00:02.875379 17139 external_mini_cluster.cc:1428] Setting key a567de22fe93863ba181fe6e1a45bb30
Aug 09 19:00:02 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302002, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:00:02.887908 9904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.870635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:59903 (local address 127.16.188.254:37119)
0809 19:00:02.872746 (+ 2111us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:02.872752 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:02.872775 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:00:02.874197 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:02.874203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:02.874291 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:02.874388 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:02.876141 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.877153 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.878819 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.879221 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.879318 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.882464 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:02.882468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:02.882471 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:02.882502 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:02.885043 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:02.885740 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:02.885746 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:02.885750 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:02.885879 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:02.886273 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:02.886278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:02.886282 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:02.886555 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:02.886696 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:02.887328 (+ 632us) server_negotiation.cc:299] Negotiation successful
0809 19:00:02.887542 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1990,"thread_start_us":1863,"threads_started":1}
I20260809 19:00:02.888849 9906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.871207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:59903)
0809 19:00:02.872031 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:02.872077 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:02.873917 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:02.874667 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:02.874679 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:02.875284 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:02.875954 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.875974 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.877309 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.877315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.878693 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.878706 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.879389 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.879393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.879609 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.880172 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:02.880199 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:02.882266 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:02.885192 (+ 2926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:02.885200 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:02.885216 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:02.885626 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:02.885980 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:02.885983 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:02.885985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:02.886167 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:02.886679 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:02.886686 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:02.886988 (+ 302us) client_negotiation.cc:769] Sending connection context
0809 19:00:02.887231 (+ 243us) client_negotiation.cc:240] Negotiation successful
0809 19:00:02.887732 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":363,"threads_started":1}
I20260809 19:00:02.890240 9902 heartbeater.cc:347] Connected to a master server at 127.16.188.254:37119
I20260809 19:00:02.890556 9902 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:02.891273 9902 heartbeater.cc:511] Master 127.16.188.254:37119 requested a full tablet report, sending...
I20260809 19:00:02.892546 9158 ts_manager.cc:194] Registered new tserver with Master: 1d60d09ce86c4ecd92e619ce8fa0d90f (127.16.188.195:41809)
I20260809 19:00:02.893388 9158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:59903
I20260809 19:00:02.902642 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:00:02.918524 9904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.907093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46456 (local address 127.16.188.254:37119)
0809 19:00:02.907317 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:02.907324 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:02.907643 (+ 319us) server_negotiation.cc:407] Connection header received
0809 19:00:02.907765 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:02.907769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:02.907843 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:02.907922 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:02.909288 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.909989 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.911256 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.911689 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.911782 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.913952 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:02.913957 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:02.913960 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:02.913992 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:02.916305 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:02.916922 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:02.916925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:02.916928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:02.917032 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:02.917349 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:02.917352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:02.917354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:02.917651 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:02.917823 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:02.918077 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 19:00:02.918236 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 19:00:02.922113 9158 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:00:02.928825 9158 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:00:02.962512 9923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.940263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48264 (local address 127.16.188.195:41809)
0809 19:00:02.953733 (+ 13470us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:02.953742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:02.953777 (+ 35us) server_negotiation.cc:407] Connection header received
0809 19:00:02.954683 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:02.954695 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:02.954923 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:02.955087 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:02.955978 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.957449 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.960114 (+ 2665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.961433 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.961606 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.961778 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:02.961979 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 19:00:02.962139 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13307,"thread_start_us":13147,"threads_started":1}
I20260809 19:00:02.962523 9922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.940008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:41809 (local address 127.0.0.1:48264)
0809 19:00:02.946995 (+ 6987us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:02.947035 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:02.947227 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:02.955354 (+ 8127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:02.955358 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:02.955378 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:02.955813 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.955824 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.957611 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.957617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.959908 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.959924 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.961638 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.961644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.961802 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.961834 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:00:02.961932 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 19:00:02.962062 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6701,"mutex_wait_us":21,"thread_start_us":381,"threads_started":1}
I20260809 19:00:02.962810 9928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.941480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57056 (local address 127.16.188.194:34199)
0809 19:00:02.954649 (+ 13169us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:02.954657 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:02.954682 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:00:02.954775 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:02.954782 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:02.954978 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:02.955178 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:02.955816 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.956943 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.959533 (+ 2590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.960805 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.960958 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.962279 (+ 1321us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:02.962354 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 19:00:02.962505 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12998,"thread_start_us":13198,"threads_started":1}
I20260809 19:00:02.963115 9930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.941817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:34199 (local address 127.0.0.1:57056)
0809 19:00:02.954037 (+ 12220us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:02.954053 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:02.954182 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:02.955167 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:02.955172 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:02.955196 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:02.955571 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.955586 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.957121 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.957126 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.959390 (+ 2264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.959403 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.961270 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.961278 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.961464 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.961516 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 19:00:02.961656 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 19:00:02.961834 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12102,"mutex_wait_us":128,"thread_start_us":11957,"threads_started":1}
I20260809 19:00:02.963557 9926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.940859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50160 (local address 127.16.188.193:40315)
0809 19:00:02.953040 (+ 12181us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:02.953051 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:02.953844 (+ 793us) server_negotiation.cc:407] Connection header received
0809 19:00:02.954029 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:02.954037 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:02.954286 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:02.954447 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:02.955107 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.956742 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.960075 (+ 3333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.961491 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.961682 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.961841 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:02.962929 (+ 1088us) server_negotiation.cc:299] Negotiation successful
0809 19:00:02.963101 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11999,"thread_start_us":12216,"threads_started":1}
I20260809 19:00:02.964000 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:02.940538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:50160)
0809 19:00:02.953721 (+ 13183us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:02.953743 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:02.953896 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:02.954475 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:02.954481 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:02.954508 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:02.954904 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.954924 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.956901 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.956907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.959908 (+ 3001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:02.959924 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:02.961940 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:02.961946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:02.962122 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:02.962155 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:00:02.962244 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 19:00:02.962361 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13058,"mutex_wait_us":134,"thread_start_us":13458,"threads_started":1}
I20260809 19:00:02.966341 9794 tablet_service.cc:1467] Processing CreateTablet for tablet e184bb2416504fa9acc67432290c84db (DEFAULT_TABLE table=test-table [id=b394063447c24bdf86f60008b76d1f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:02.967641 9794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e184bb2416504fa9acc67432290c84db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:02.967127 9571 tablet_service.cc:1467] Processing CreateTablet for tablet e184bb2416504fa9acc67432290c84db (DEFAULT_TABLE table=test-table [id=b394063447c24bdf86f60008b76d1f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:02.967322 9363 tablet_service.cc:1467] Processing CreateTablet for tablet e184bb2416504fa9acc67432290c84db (DEFAULT_TABLE table=test-table [id=b394063447c24bdf86f60008b76d1f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:02.968483 9363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e184bb2416504fa9acc67432290c84db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:02.968483 9571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e184bb2416504fa9acc67432290c84db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:02.978813 9931 tablet_bootstrap.cc:492] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Bootstrap starting.
I20260809 19:00:02.981869 9931 tablet_bootstrap.cc:654] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:02.983080 9931 log.cc:824] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:02.984385 9934 tablet_bootstrap.cc:492] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Bootstrap starting.
I20260809 19:00:02.985728 9936 tablet_bootstrap.cc:492] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Bootstrap starting.
I20260809 19:00:02.986104 9931 tablet_bootstrap.cc:492] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: No bootstrap required, opened a new log
I20260809 19:00:02.986372 9931 ts_tablet_manager.cc:1397] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 19:00:02.988201 9934 tablet_bootstrap.cc:654] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:02.988886 9936 tablet_bootstrap.cc:654] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:02.989329 9934 log.cc:824] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:02.990010 9936 log.cc:824] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:02.992833 9936 tablet_bootstrap.cc:492] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: No bootstrap required, opened a new log
I20260809 19:00:02.992966 9934 tablet_bootstrap.cc:492] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: No bootstrap required, opened a new log
I20260809 19:00:02.993132 9936 ts_tablet_manager.cc:1397] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 19:00:02.993229 9934 ts_tablet_manager.cc:1397] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260809 19:00:02.994843 9931 raft_consensus.cc:348] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:02.995153 9931 raft_consensus.cc:374] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:02.995246 9931 raft_consensus.cc:729] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d60d09ce86c4ecd92e619ce8fa0d90f, State: Initialized, Role: FOLLOWER
I20260809 19:00:02.995818 9931 consensus_queue.cc:260] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:02.996814 9902 heartbeater.cc:503] Master 127.16.188.254:37119 was elected leader, sending a full tablet report...
I20260809 19:00:02.997494 9931 ts_tablet_manager.cc:1428] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260809 19:00:03.003361 9936 raft_consensus.cc:348] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:03.003803 9936 raft_consensus.cc:374] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:03.003922 9936 raft_consensus.cc:729] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb8211b53c44b879d48d5555c067d96, State: Initialized, Role: FOLLOWER
I20260809 19:00:03.003875 9934 raft_consensus.cc:348] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:03.004277 9934 raft_consensus.cc:374] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:03.004384 9934 raft_consensus.cc:729] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7837a3630f4a379e1b5d5bc2e10f6e, State: Initialized, Role: FOLLOWER
I20260809 19:00:03.004611 9936 consensus_queue.cc:260] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:03.004957 9934 consensus_queue.cc:260] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:03.006024 9677 heartbeater.cc:503] Master 127.16.188.254:37119 was elected leader, sending a full tablet report...
I20260809 19:00:03.006425 9936 ts_tablet_manager.cc:1428] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Time spent starting tablet: real 0.013s user 0.006s sys 0.006s
I20260809 19:00:03.006587 9934 ts_tablet_manager.cc:1428] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260809 19:00:03.074296 9467 tablet.cc:2369] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:03.076200 9947 raft_consensus.cc:482] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:03.076480 9947 raft_consensus.cc:504] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:03.078148 9947 leader_election.cc:288] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d60d09ce86c4ecd92e619ce8fa0d90f (127.16.188.195:41809), 5eb8211b53c44b879d48d5555c067d96 (127.16.188.193:40315)
I20260809 19:00:03.084833 9926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:03.078639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:48701 (local address 127.16.188.193:40315)
0809 19:00:03.078840 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:03.078846 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:03.079403 (+ 557us) server_negotiation.cc:407] Connection header received
0809 19:00:03.079666 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:03.079673 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:03.079753 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:03.079847 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:03.080521 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.081317 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.083142 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.083878 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.084021 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:03.084099 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:03.084449 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 19:00:03.084582 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:00:03.084872 9923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:03.078491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:54483 (local address 127.16.188.195:41809)
0809 19:00:03.078700 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:03.078707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:03.079531 (+ 824us) server_negotiation.cc:407] Connection header received
0809 19:00:03.079765 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:03.079771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:03.079852 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:03.079935 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:03.080703 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.081440 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.083148 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.083893 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.084034 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:03.084105 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:03.084514 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 19:00:03.084632 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:00:03.085047 9948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:03.078455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.16.188.194:48701)
0809 19:00:03.079294 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:03.079314 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:03.079468 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:03.079877 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:03.079882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:03.079906 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:03.080372 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:03.080390 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.081443 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.081448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:03.082982 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:03.082995 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.084161 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.084167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:03.084283 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:03.084314 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:00:03.084404 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 19:00:03.084530 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":25,"thread_start_us":422,"threads_started":1}
I20260809 19:00:03.085067 9949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:03.078507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:41809 (local address 127.16.188.194:54483)
0809 19:00:03.079427 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:03.079444 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:03.079571 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:03.080049 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:03.080053 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:03.080080 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:03.080536 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:03.080550 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.081580 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.081584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:03.083004 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:03.083016 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.084167 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.084173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:03.084347 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:03.084371 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 19:00:03.084473 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 19:00:03.084587 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":802,"mutex_wait_us":19,"thread_start_us":617,"threads_started":1}
I20260809 19:00:03.085999 9829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e184bb2416504fa9acc67432290c84db" candidate_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" is_pre_election: true
I20260809 19:00:03.086086 9397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e184bb2416504fa9acc67432290c84db" candidate_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb8211b53c44b879d48d5555c067d96" is_pre_election: true
I20260809 19:00:03.086467 9829 raft_consensus.cc:2454] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb7837a3630f4a379e1b5d5bc2e10f6e in term 0.
I20260809 19:00:03.086524 9397 raft_consensus.cc:2454] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb7837a3630f4a379e1b5d5bc2e10f6e in term 0.
I20260809 19:00:03.087077 9497 leader_election.cc:302] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb8211b53c44b879d48d5555c067d96, bb7837a3630f4a379e1b5d5bc2e10f6e; no voters:
I20260809 19:00:03.087431 9947 raft_consensus.cc:2781] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:00:03.087549 9947 raft_consensus.cc:482] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:00:03.087656 9947 raft_consensus.cc:3037] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:03.089877 9947 raft_consensus.cc:504] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:03.090488 9947 leader_election.cc:288] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [CANDIDATE]: Term 1 election: Requested vote from peers 1d60d09ce86c4ecd92e619ce8fa0d90f (127.16.188.195:41809), 5eb8211b53c44b879d48d5555c067d96 (127.16.188.193:40315)
I20260809 19:00:03.090838 9829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e184bb2416504fa9acc67432290c84db" candidate_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f"
I20260809 19:00:03.090950 9397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e184bb2416504fa9acc67432290c84db" candidate_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb8211b53c44b879d48d5555c067d96"
I20260809 19:00:03.091044 9829 raft_consensus.cc:3037] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:03.091141 9397 raft_consensus.cc:3037] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:03.094180 9397 raft_consensus.cc:2454] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb7837a3630f4a379e1b5d5bc2e10f6e in term 1.
I20260809 19:00:03.094195 9829 raft_consensus.cc:2454] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb7837a3630f4a379e1b5d5bc2e10f6e in term 1.
I20260809 19:00:03.094586 9502 leader_election.cc:302] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1d60d09ce86c4ecd92e619ce8fa0d90f, 5eb8211b53c44b879d48d5555c067d96, bb7837a3630f4a379e1b5d5bc2e10f6e; no voters:
I20260809 19:00:03.094906 9947 raft_consensus.cc:2781] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:03.095307 9947 raft_consensus.cc:686] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 LEADER]: Becoming Leader. State: Replica: bb7837a3630f4a379e1b5d5bc2e10f6e, State: Running, Role: LEADER
I20260809 19:00:03.095738 9947 consensus_queue.cc:237] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
W20260809 19:00:03.099714 9678 tablet.cc:2369] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:03.100500 9157 catalog_manager.cc:5495] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e reported cstate change: term changed from 0 to 1, leader changed from <none> to bb7837a3630f4a379e1b5d5bc2e10f6e (127.16.188.194). New cstate: current_term: 1 leader_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } health_report { overall_health: UNKNOWN } } }
W20260809 19:00:03.119513 9903 tablet.cc:2369] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:03.121516 9928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:03.116079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57072 (local address 127.16.188.194:34199)
0809 19:00:03.116286 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:03.116293 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:03.116394 (+ 101us) server_negotiation.cc:407] Connection header received
0809 19:00:03.116602 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:03.116606 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:03.116687 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:03.116819 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:03.117131 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.117917 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.119361 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.119780 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.119870 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:03.120473 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:03.120943 (+ 470us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:00:03.121049 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:03.121200 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 19:00:03.121266 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:00:03.129129 9829 raft_consensus.cc:1261] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 1 FOLLOWER]: Refusing update from remote peer bb7837a3630f4a379e1b5d5bc2e10f6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:03.129153 9397 raft_consensus.cc:1261] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 1 FOLLOWER]: Refusing update from remote peer bb7837a3630f4a379e1b5d5bc2e10f6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:03.130105 9950 consensus_queue.cc:1035] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:03.130452 9947 consensus_queue.cc:1035] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:03.142493 9954 mvcc.cc:205] Tried to move back new op lower bound from 7316693004807778304 to 7316693004684115968. Current Snapshot: MvccSnapshot[applied={T|T < 7316693004807778304}]
I20260809 19:00:03.149686 9960 mvcc.cc:205] Tried to move back new op lower bound from 7316693004807778304 to 7316693004684115968. Current Snapshot: MvccSnapshot[applied={T|T < 7316693004807778304}]
I20260809 19:00:03.156152 9157 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:03.156446 9157 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:03.160236 9157 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Sending DeleteTablet for 3 replicas of tablet e184bb2416504fa9acc67432290c84db
I20260809 19:00:03.161348 9794 tablet_service.cc:1514] Processing DeleteTablet for tablet e184bb2416504fa9acc67432290c84db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:03 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:48264
I20260809 19:00:03.161489 9571 tablet_service.cc:1514] Processing DeleteTablet for tablet e184bb2416504fa9acc67432290c84db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:03 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:57056
I20260809 19:00:03.161549 9363 tablet_service.cc:1514] Processing DeleteTablet for tablet e184bb2416504fa9acc67432290c84db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:03 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:50160
I20260809 19:00:03.166252 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 9261
I20260809 19:00:03.176085 9974 tablet_replica.cc:330] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: stopping tablet replica
I20260809 19:00:03.176095 9973 tablet_replica.cc:330] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: stopping tablet replica
I20260809 19:00:03.176517 9972 tablet_replica.cc:330] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: stopping tablet replica
I20260809 19:00:03.176630 9973 raft_consensus.cc:2229] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:03.176893 9972 raft_consensus.cc:2229] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:03.177222 9973 raft_consensus.cc:2258] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:03.177389 9972 raft_consensus.cc:2258] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:03.178113 9974 raft_consensus.cc:2229] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:00:03.178791 9974 raft_consensus.cc:2258] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:03.179649 9973 ts_tablet_manager.cc:1905] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:03.181510 9972 ts_tablet_manager.cc:1905] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:03.182843 9974 ts_tablet_manager.cc:1905] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:03.187158 9973 ts_tablet_manager.cc:1918] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:03.187386 9973 log.cc:1196] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/e184bb2416504fa9acc67432290c84db
I20260809 19:00:03.187968 9973 ts_tablet_manager.cc:1939] T e184bb2416504fa9acc67432290c84db P 5eb8211b53c44b879d48d5555c067d96: Deleting consensus metadata
Aug 09 19:00:03 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 19:00:03.189949 9974 ts_tablet_manager.cc:1918] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:03.189991 9131 catalog_manager.cc:4841] TS 5eb8211b53c44b879d48d5555c067d96 (127.16.188.193:40315): tablet e184bb2416504fa9acc67432290c84db (table test-table [id=b394063447c24bdf86f60008b76d1f2e]) successfully deleted
I20260809 19:00:03.190203 9974 log.cc:1196] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/e184bb2416504fa9acc67432290c84db
I20260809 19:00:03.190739 9974 ts_tablet_manager.cc:1939] T e184bb2416504fa9acc67432290c84db P bb7837a3630f4a379e1b5d5bc2e10f6e: Deleting consensus metadata
I20260809 19:00:03.191592 9972 ts_tablet_manager.cc:1918] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:03.191825 9972 log.cc:1196] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/e184bb2416504fa9acc67432290c84db
I20260809 19:00:03.192358 9972 ts_tablet_manager.cc:1939] T e184bb2416504fa9acc67432290c84db P 1d60d09ce86c4ecd92e619ce8fa0d90f: Deleting consensus metadata
I20260809 19:00:03.192759 9135 catalog_manager.cc:4841] TS bb7837a3630f4a379e1b5d5bc2e10f6e (127.16.188.194:34199): tablet e184bb2416504fa9acc67432290c84db (table test-table [id=b394063447c24bdf86f60008b76d1f2e]) successfully deleted
I20260809 19:00:03.193966 9135 catalog_manager.cc:4841] TS 1d60d09ce86c4ecd92e619ce8fa0d90f (127.16.188.195:41809): tablet e184bb2416504fa9acc67432290c84db (table test-table [id=b394063447c24bdf86f60008b76d1f2e]) successfully deleted
I20260809 19:00:03.198146 9926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:03.167380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50170 (local address 127.16.188.193:40315)
0809 19:00:03.167563 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:03.167570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:03.171535 (+ 3965us) server_negotiation.cc:407] Connection header received
0809 19:00:03.172520 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:03.172527 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:03.172618 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:03.172690 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:03.176338 (+ 3648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.177590 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.179766 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.180425 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.180526 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:03.191118 (+ 10592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:03.191133 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:03.191152 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:03.191197 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:03.195141 (+ 3944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:03.195831 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:03.195841 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:03.195845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:03.196021 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:03.196380 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:03.196385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:03.196389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:03.196869 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:03.197240 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:03.197489 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 19:00:03.197714 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:00:03.198859 9458 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:00:03.287232 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 9261
I20260809 19:00:03.318215 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 9474
Aug 09 19:00:03 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 19:00:03.335871 9928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:03.319029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57086 (local address 127.16.188.194:34199)
0809 19:00:03.319255 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:03.319262 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:03.319285 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:00:03.319360 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:03.319367 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:03.319461 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:03.319583 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:03.320882 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.322130 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.323383 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.324107 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.324255 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:03.328695 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:03.328718 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:03.328738 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:03.328782 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:03.332837 (+ 4055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:03.333562 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:03.333573 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:03.333578 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:03.333769 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:03.334117 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:03.334123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:03.334127 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:03.334631 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:03.335023 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:03.335195 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 19:00:03.335439 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 19:00:03.336675 9668 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:00:03.445961 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 9474
I20260809 19:00:03.472807 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 9689
Aug 09 19:00:03 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 19:00:03.487253 9923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:03.473575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48276 (local address 127.16.188.195:41809)
0809 19:00:03.473756 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:03.473762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:03.473781 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:00:03.473964 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:03.473970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:03.474052 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:03.474136 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:03.475441 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.476182 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.477476 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:03.477893 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:03.478002 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:03.482273 (+ 4271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:03.482287 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:03.482304 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:03.482337 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:03.484827 (+ 2490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:03.485520 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:03.485527 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:03.485530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:03.485685 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:03.486038 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:03.486042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:03.486044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:03.486378 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:03.486599 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:03.486851 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 19:00:03.487012 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:00:03.487845 9896 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:00:03.574884 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 9689
I20260809 19:00:03.599097 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 9110
I20260809 19:00:03.600199 9208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:00:03.707186 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 9110
I20260809 19:00:23.736699 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:37119
--webserver_interface=127.16.188.254
--webserver_port=46147
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:37119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:24.090021 9984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:24.090291 9984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:24.090425 9984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:24.097817 9984 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 19:00:24.097914 9984 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 19:00:24.097978 9984 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 19:00:24.098047 9984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:24.098119 9984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:24.098212 9984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:24.098271 9984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:24.098347 9984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:24.108072 9984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:37119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:37119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=46147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:24.109293 9984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:24.110607 9984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:24.134160 9991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:24.134220 9994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:24.134253 9992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:24.135095 9984 server_base.cc:1034] running on GCE node
I20260809 19:00:24.135931 9984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:24.137465 9984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:24.138681 9984 hybrid_clock.cc:648] HybridClock initialized: now 1786302024138602 us; error 50 us; skew 500 ppm
I20260809 19:00:24.139035 9984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:24 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302024, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:24.142385 9984 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:00:24.143862 9984 webserver.cc:460] Webserver started at http://127.16.188.254:46147/ using document root <none> and password file <none>
I20260809 19:00:24.144591 9984 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:24.144708 9984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:24.150348 9984 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:00:24.153298 10004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:24.154487 9984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:00:24.154646 9984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "9fbf8c3d7bea4591842115458520485c"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "7f3041255daad660f1ed54081ef261c4"
server_key_iv: "89c63cd8e1d48ff2f9e3e8d9d5665592"
server_key_version: "encryptionkey@0"
I20260809 19:00:24.155642 9984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:24.179787 9984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:24.183714 9984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:24.183985 9984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:24.201619 9984 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:37119
I20260809 19:00:24.201660 10076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:37119 every 8 connection(s)
I20260809 19:00:24.203076 9984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:24.207752 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 9984
I20260809 19:00:24.208590 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:40315
--local_ip_for_outbound_sockets=127.16.188.193
--tserver_master_addrs=127.16.188.254:37119
--webserver_port=37257
--webserver_interface=127.16.188.193
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:00:24.210342 10078 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:00:24.213749 10078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Bootstrap starting.
I20260809 19:00:24.237432 10078 log.cc:824] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:24.253383 10078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:00:24.254000 10078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Bootstrap complete.
I20260809 19:00:24.267261 10078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:24.268417 10078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbf8c3d7bea4591842115458520485c, State: Initialized, Role: FOLLOWER
I20260809 19:00:24.269218 10078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:24.269507 10078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:24.269639 10078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:24.269826 10078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 1 FOLLOWER]: Advancing to term 2
I20260809 19:00:24.275275 10078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:24.275902 10078 leader_election.cc:302] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fbf8c3d7bea4591842115458520485c; no voters:
I20260809 19:00:24.276563 10078 leader_election.cc:288] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 19:00:24.276678 10086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 2 FOLLOWER]: Leader election won for term 2
I20260809 19:00:24.277729 10086 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 2 LEADER]: Becoming Leader. State: Replica: 9fbf8c3d7bea4591842115458520485c, State: Running, Role: LEADER
I20260809 19:00:24.278263 10086 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:24.278702 10078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:24.280464 10088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fbf8c3d7bea4591842115458520485c. Latest consensus state: current_term: 2 leader_uuid: "9fbf8c3d7bea4591842115458520485c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } } }
I20260809 19:00:24.280818 10088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:24.281370 10087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9fbf8c3d7bea4591842115458520485c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } } }
I20260809 19:00:24.281702 10087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:24.292076 10092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:24.300299 10092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:24.301723 10092 catalog_manager.cc:1259] Loaded cluster ID: 2262be319dfc4192826e99f220872ce6
I20260809 19:00:24.301865 10092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:24.306051 10092 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:24.307928 10092 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Loaded TSK: 0
I20260809 19:00:24.320458 10112 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 19:00:24.339730 10092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Generated new TSK 1
I20260809 19:00:24.340171 10092 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 19:00:24.578483 10082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:24.578810 10082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:24.578960 10082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:24.586226 10082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:24.586328 10082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:24.586468 10082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:00:24.595921 10082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:40315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=37257
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:24.597164 10082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:24.598435 10082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:24.612874 10126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:24.612874 10129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:24.613817 10122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:24.614239 10082 server_base.cc:1034] running on GCE node
I20260809 19:00:24.614833 10082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:24.615775 10082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:24.616979 10082 hybrid_clock.cc:648] HybridClock initialized: now 1786302024616925 us; error 47 us; skew 500 ppm
I20260809 19:00:24.617308 10082 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:24 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302024, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:24.620240 10082 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 19:00:24.621706 10082 webserver.cc:460] Webserver started at http://127.16.188.193:37257/ using document root <none> and password file <none>
I20260809 19:00:24.622360 10082 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:24.622485 10082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:24.627564 10082 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 19:00:24.630149 10142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:24.631431 10082 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:00:24.631577 10082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "5eb8211b53c44b879d48d5555c067d96"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "52bbdc09936ab6d1ca20237bad500fe6"
server_key_iv: "742fa8cc5c4f221f300aea300bf608f7"
server_key_version: "encryptionkey@0"
I20260809 19:00:24.632489 10082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:24.654933 10082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:24.659096 10082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:24.659340 10082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:24.660287 10082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:24.661639 10082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:24.661733 10082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:24.661831 10082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:24.661911 10082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:24.691828 10082 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:40315
I20260809 19:00:24.691924 10324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:40315 every 8 connection(s)
I20260809 19:00:24.693356 10082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:24.702132 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 10082
I20260809 19:00:24.702898 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:34199
--local_ip_for_outbound_sockets=127.16.188.194
--tserver_master_addrs=127.16.188.254:37119
--webserver_port=34977
--webserver_interface=127.16.188.194
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:00:24 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302024, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:00:24.716501 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:24.695971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:55863 (local address 127.16.188.254:37119)
0809 19:00:24.696585 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:24.696600 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:24.697040 (+ 440us) server_negotiation.cc:407] Connection header received
0809 19:00:24.699021 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:24.699032 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:24.699333 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:24.699608 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:24.700866 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:24.702114 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:24.704190 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:24.704885 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:24.705010 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:24.708947 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:24.708957 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:24.708973 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:24.709015 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:24.712355 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:24.713130 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:24.713139 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:24.713147 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:24.713361 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:24.713805 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:24.713810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:24.713814 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:24.714265 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:24.714447 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:24.715302 (+ 855us) server_negotiation.cc:299] Negotiation successful
0809 19:00:24.715600 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":240,"threads_started":1}
I20260809 19:00:24.716799 10328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:24.696135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:55863)
0809 19:00:24.696868 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:24.696911 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:24.698559 (+ 1648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:24.699723 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:24.699730 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:24.700196 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:24.700717 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:24.700732 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:24.702286 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:24.702291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:24.704058 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:24.704074 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:24.705128 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:24.705136 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:24.705396 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:24.706111 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:24.706145 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:24.708661 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:24.712487 (+ 3826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:24.712496 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:24.712509 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:24.712976 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:24.713454 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:24.713458 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:24.713461 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:24.713662 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:24.714418 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:24.714425 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:24.714828 (+ 403us) client_negotiation.cc:769] Sending connection context
0809 19:00:24.715121 (+ 293us) client_negotiation.cc:240] Negotiation successful
0809 19:00:24.715632 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":304,"threads_started":1}
I20260809 19:00:24.719485 10325 heartbeater.cc:347] Connected to a master server at 127.16.188.254:37119
I20260809 19:00:24.719755 10325 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:24.720439 10325 heartbeater.cc:511] Master 127.16.188.254:37119 requested a full tablet report, sending...
I20260809 19:00:24.722469 10028 ts_manager.cc:194] Registered new tserver with Master: 5eb8211b53c44b879d48d5555c067d96 (127.16.188.193:40315)
I20260809 19:00:24.723903 10028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:55863
W20260809 19:00:25.032881 10329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:25.033172 10329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:25.033322 10329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:25.040251 10329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:25.040359 10329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:25.040506 10329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:00:25.049708 10329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:34199
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=34977
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:25.050923 10329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:25.052162 10329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:25.064417 10341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:25.064545 10345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:25.064574 10342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:25.065476 10329 server_base.cc:1034] running on GCE node
I20260809 19:00:25.066030 10329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:25.066885 10329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:25.068080 10329 hybrid_clock.cc:648] HybridClock initialized: now 1786302025068027 us; error 46 us; skew 500 ppm
I20260809 19:00:25.068365 10329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:25 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302025, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:25.071238 10329 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 19:00:25.072489 10329 webserver.cc:460] Webserver started at http://127.16.188.194:34977/ using document root <none> and password file <none>
I20260809 19:00:25.073107 10329 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:25.073235 10329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:25.078151 10329 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 19:00:25.080606 10355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:25.081874 10329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:00:25.082008 10329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "005e317c1c8f97c22afb11ae0b4344d2"
server_key_iv: "95079513cf176c09fc48885136121bfe"
server_key_version: "encryptionkey@0"
I20260809 19:00:25.082862 10329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:25.098070 10329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:25.101914 10329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:25.102128 10329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:25.102946 10329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:25.104136 10329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:25.104228 10329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:25.104303 10329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:25.104425 10329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 19:00:25.133564 10329 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:34199
I20260809 19:00:25.133632 10531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:34199 every 8 connection(s)
I20260809 19:00:25.134896 10329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:00:25.142024 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 10329
I20260809 19:00:25.142623 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:41809
--local_ip_for_outbound_sockets=127.16.188.195
--tserver_master_addrs=127.16.188.254:37119
--webserver_port=44763
--webserver_interface=127.16.188.195
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 19:00:25 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302025, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:00:25.153782 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.137325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:49945 (local address 127.16.188.254:37119)
0809 19:00:25.137523 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.137529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.138594 (+ 1065us) server_negotiation.cc:407] Connection header received
0809 19:00:25.140256 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.140261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.140327 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.140409 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:25.141761 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.142483 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.144541 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.144944 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.145040 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.148536 (+ 3496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:25.148541 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:25.148544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:25.148576 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:25.150984 (+ 2408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:25.151643 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:25.151647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:25.151649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:25.151768 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:25.152168 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:25.152171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:25.152173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:25.152432 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:25.152580 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.153216 (+ 636us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.153456 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:00:25.154663 10538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.137778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:49945)
0809 19:00:25.138447 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.138482 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:25.140028 (+ 1546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:25.140579 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:25.140586 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:25.141050 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:25.141598 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.141616 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.142651 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.142656 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.144408 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.144424 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.145169 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.145176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.145438 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.146062 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:25.146089 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:25.148329 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:25.151128 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:25.151137 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:25.151151 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:25.151523 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:25.151867 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:25.151872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:25.151876 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:25.152057 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:25.152552 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:25.152559 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:25.152863 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 19:00:25.153071 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 19:00:25.153546 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":261,"threads_started":1}
I20260809 19:00:25.155972 10534 heartbeater.cc:347] Connected to a master server at 127.16.188.254:37119
I20260809 19:00:25.156279 10534 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:25.157060 10534 heartbeater.cc:511] Master 127.16.188.254:37119 requested a full tablet report, sending...
I20260809 19:00:25.158629 10028 ts_manager.cc:194] Registered new tserver with Master: bb7837a3630f4a379e1b5d5bc2e10f6e (127.16.188.194:34199)
I20260809 19:00:25.159667 10028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:49945
W20260809 19:00:25.475772 10539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:25.476051 10539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:25.476145 10539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:25.483276 10539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:25.483374 10539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:25.483490 10539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:00:25.492810 10539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:41809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=44763
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:25.494076 10539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:25.495299 10539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:25.507875 10545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:25.507944 10546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:25.507915 10552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:25.509305 10539 server_base.cc:1034] running on GCE node
I20260809 19:00:25.509866 10539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:25.510748 10539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:25.511950 10539 hybrid_clock.cc:648] HybridClock initialized: now 1786302025511908 us; error 38 us; skew 500 ppm
I20260809 19:00:25.512231 10539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:25 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302025, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:25.515164 10539 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 19:00:25.516525 10539 webserver.cc:460] Webserver started at http://127.16.188.195:44763/ using document root <none> and password file <none>
I20260809 19:00:25.517201 10539 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:25.517331 10539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:25.522316 10539 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:00:25.524775 10565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:25.526021 10539 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:00:25.526171 10539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "8f4df408d4b9ac118babd444306f911a"
server_key_iv: "89a2515a9d326c88053b4d702c7ccd89"
server_key_version: "encryptionkey@0"
I20260809 19:00:25.527072 10539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:25.560910 10539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:25.564777 10539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:25.565012 10539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:25.565950 10539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:25.567183 10539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:25.567286 10539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:25.567400 10539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:25.567471 10539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:25.598294 10539 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:41809
I20260809 19:00:25.598358 10745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:41809 every 8 connection(s)
I20260809 19:00:25.599642 10539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:00:25.601850 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 10539
Aug 09 19:00:25 dist-test-slave-266d krb5kdc[9094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302025, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:00:25.621592 10751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.602847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52020 (local address 127.16.188.254:37119)
0809 19:00:25.604222 (+ 1375us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.604226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.607197 (+ 2971us) server_negotiation.cc:407] Connection header received
0809 19:00:25.607358 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.607362 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.607419 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.607506 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:25.609171 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.609896 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.611319 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.611753 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.611874 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.615050 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:25.615056 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:25.615060 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:25.615114 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:25.619040 (+ 3926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:25.619759 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:25.619762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:25.619764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:25.619901 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:25.620280 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:25.620283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:25.620285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:25.620585 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:25.620840 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.621124 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.621293 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1287,"thread_start_us":1175,"threads_started":1}
I20260809 19:00:25.622185 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.602142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:57765 (local address 127.16.188.254:37119)
0809 19:00:25.602310 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.602315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.603780 (+ 1465us) server_negotiation.cc:407] Connection header received
0809 19:00:25.606618 (+ 2838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.606622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.606689 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.606787 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:25.608350 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.609068 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.610586 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.611014 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.611123 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.614972 (+ 3849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:25.614978 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:25.614983 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:25.615022 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:25.619132 (+ 4110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:25.619908 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:25.619912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:25.619915 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:25.620045 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:25.620465 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:25.620470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:25.620473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:25.620771 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:25.620887 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.621701 (+ 814us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.621891 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":84,"server-negotiator.queue_time_us":53}
I20260809 19:00:25.623944 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.602645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:57765)
0809 19:00:25.603541 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.603595 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:25.606302 (+ 2707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:25.607059 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:25.607070 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:25.607632 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:00:25.608182 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.608199 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.609254 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.609259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.610448 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.610460 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.611228 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.611236 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.611484 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.612146 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:00:25.612176 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:00:25.614750 (+ 2574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:00:25.619268 (+ 4518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:25.619277 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:25.619292 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:25.619815 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:25.620143 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:00:25.620148 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:00:25.620151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:00:25.620364 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:00:25.620894 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:00:25.620901 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:00:25.621309 (+ 408us) client_negotiation.cc:769] Sending connection context
0809 19:00:25.622359 (+ 1050us) client_negotiation.cc:240] Negotiation successful
0809 19:00:25.622726 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":347,"threads_started":1}
I20260809 19:00:25.625124 10746 heartbeater.cc:347] Connected to a master server at 127.16.188.254:37119
I20260809 19:00:25.625408 10746 heartbeater.cc:464] Registering TS with master...
I20260809 19:00:25.626085 10746 heartbeater.cc:511] Master 127.16.188.254:37119 requested a full tablet report, sending...
I20260809 19:00:25.627351 10028 ts_manager.cc:194] Registered new tserver with Master: 1d60d09ce86c4ecd92e619ce8fa0d90f (127.16.188.195:41809)
I20260809 19:00:25.628094 10028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:57765
I20260809 19:00:25.636219 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:00:25.642095 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.637158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52022 (local address 127.16.188.254:37119)
0809 19:00:25.637324 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.637330 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.637733 (+ 403us) server_negotiation.cc:407] Connection header received
0809 19:00:25.637899 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.637903 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.638029 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.638132 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:25.638494 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.639203 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.640479 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.640867 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.640947 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.641414 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:25.641662 (+ 248us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 19:00:25.641931 (+ 269us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52022: token expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 19:00:25.642204 10327 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52022: token expired
W20260809 19:00:25.642793 9908 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.16.188.254:37119)
I20260809 19:00:25.654377 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.643351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52026 (local address 127.16.188.254:37119)
0809 19:00:25.643493 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.643497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.643511 (+ 14us) server_negotiation.cc:407] Connection header received
0809 19:00:25.643544 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.643547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.643594 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.643661 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:25.644849 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.645555 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.646749 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.647128 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.647208 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.649919 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:25.649923 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:25.649927 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:25.649954 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:25.652331 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:25.652871 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:25.652874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:25.652876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:25.652975 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:25.653280 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:25.653283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:25.653285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:25.653554 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:25.653727 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.653952 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.654093 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:00:25.657585 10028 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:00:25.664863 10028 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:00:25.686728 10762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.675879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:41809 (local address 127.0.0.1:33788)
0809 19:00:25.676799 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.676848 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:25.677010 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:25.678074 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:25.678083 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:25.678115 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:25.678571 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.678584 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.680860 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.680866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.683406 (+ 2540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.683424 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.685703 (+ 2279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.685710 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.685938 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.685991 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 19:00:25.686118 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 19:00:25.686326 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":1346,"threads_started":1}
I20260809 19:00:25.687781 10764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.676178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33788 (local address 127.16.188.195:41809)
0809 19:00:25.677151 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.677159 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.677195 (+ 36us) server_negotiation.cc:407] Connection header received
0809 19:00:25.677307 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.677316 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.677569 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.677752 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:25.678820 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.680688 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.683615 (+ 2927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.685134 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.685339 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.685534 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.687230 (+ 1696us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.687429 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":596,"threads_started":1}
I20260809 19:00:25.695464 10640 tablet_service.cc:1467] Processing CreateTablet for tablet 236334c106fe44989210650080a42037 (DEFAULT_TABLE table=test-table [id=1a1bdebc43b946d79c93c21bf5e45bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:25.697284 10640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 236334c106fe44989210650080a42037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:25.699369 10762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.677954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:34199 (local address 127.0.0.1:48974)
0809 19:00:25.686964 (+ 9010us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.686980 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:25.687067 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:25.691696 (+ 4629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:25.691700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:25.691725 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:25.691886 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.691895 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.693835 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.693840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.695744 (+ 1904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.695784 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.697567 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.697574 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.697756 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.698847 (+ 1091us) client_negotiation.cc:769] Sending connection context
0809 19:00:25.698919 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 19:00:25.699061 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8932,"thread_start_us":13310,"threads_started":1}
I20260809 19:00:25.699966 10766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.676603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:58258)
0809 19:00:25.677753 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.677774 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:25.677884 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:25.690372 (+ 12488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:25.690377 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:25.690404 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:25.690762 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.690776 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.695296 (+ 4520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.695302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.697386 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.697401 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.699303 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.699311 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.699474 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.699506 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:00:25.699571 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 19:00:25.699668 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1037,"thread_start_us":899,"threads_started":1}
I20260809 19:00:25.700521 10771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.678357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48974 (local address 127.16.188.194:34199)
0809 19:00:25.691155 (+ 12798us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.691163 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.691190 (+ 27us) server_negotiation.cc:407] Connection header received
0809 19:00:25.691280 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.691288 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.691496 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.692041 (+ 545us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:25.692257 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.693703 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.695959 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.697383 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.699827 (+ 2444us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.699993 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.700064 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.700243 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12638,"thread_start_us":12535,"threads_started":1}
I20260809 19:00:25.700871 10767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.677201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58258 (local address 127.16.188.193:40315)
0809 19:00:25.689871 (+ 12670us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.689877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.689901 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:00:25.689977 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.689982 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.690188 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.690372 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:25.690962 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.695125 (+ 4163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.697599 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.699047 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.700322 (+ 1275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.700435 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.700483 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.700586 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12532,"thread_start_us":13371,"threads_started":1}
I20260809 19:00:25.703702 10433 tablet_service.cc:1467] Processing CreateTablet for tablet 236334c106fe44989210650080a42037 (DEFAULT_TABLE table=test-table [id=1a1bdebc43b946d79c93c21bf5e45bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:25.704241 10215 tablet_service.cc:1467] Processing CreateTablet for tablet 236334c106fe44989210650080a42037 (DEFAULT_TABLE table=test-table [id=1a1bdebc43b946d79c93c21bf5e45bc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:00:25.704871 10433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 236334c106fe44989210650080a42037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:25.705852 10215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 236334c106fe44989210650080a42037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:00:25.713073 10774 tablet_bootstrap.cc:492] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Bootstrap starting.
I20260809 19:00:25.716810 10776 tablet_bootstrap.cc:492] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Bootstrap starting.
I20260809 19:00:25.717129 10774 tablet_bootstrap.cc:654] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:25.718240 10774 log.cc:824] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:25.719993 10783 tablet_bootstrap.cc:492] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Bootstrap starting.
I20260809 19:00:25.720180 10776 tablet_bootstrap.cc:654] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:25.721184 10776 log.cc:824] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:25.721676 10774 tablet_bootstrap.cc:492] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: No bootstrap required, opened a new log
I20260809 19:00:25.722010 10774 ts_tablet_manager.cc:1397] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260809 19:00:25.723425 10783 tablet_bootstrap.cc:654] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Neither blocks nor log segments found. Creating new log.
I20260809 19:00:25.723481 10776 tablet_bootstrap.cc:492] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: No bootstrap required, opened a new log
I20260809 19:00:25.723711 10776 ts_tablet_manager.cc:1397] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260809 19:00:25.724582 10783 log.cc:824] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:25.726727 10325 heartbeater.cc:503] Master 127.16.188.254:37119 was elected leader, sending a full tablet report...
I20260809 19:00:25.727571 10783 tablet_bootstrap.cc:492] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: No bootstrap required, opened a new log
I20260809 19:00:25.727888 10783 ts_tablet_manager.cc:1397] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 19:00:25.731984 10774 raft_consensus.cc:348] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.732419 10774 raft_consensus.cc:374] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:25.732532 10774 raft_consensus.cc:729] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d60d09ce86c4ecd92e619ce8fa0d90f, State: Initialized, Role: FOLLOWER
I20260809 19:00:25.732936 10776 raft_consensus.cc:348] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.733321 10776 raft_consensus.cc:374] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:25.733163 10774 consensus_queue.cc:260] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.733418 10776 raft_consensus.cc:729] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7837a3630f4a379e1b5d5bc2e10f6e, State: Initialized, Role: FOLLOWER
I20260809 19:00:25.734282 10746 heartbeater.cc:503] Master 127.16.188.254:37119 was elected leader, sending a full tablet report...
I20260809 19:00:25.734097 10776 consensus_queue.cc:260] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.734867 10774 ts_tablet_manager.cc:1428] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260809 19:00:25.735759 10534 heartbeater.cc:503] Master 127.16.188.254:37119 was elected leader, sending a full tablet report...
I20260809 19:00:25.736653 10776 ts_tablet_manager.cc:1428] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
I20260809 19:00:25.738322 10783 raft_consensus.cc:348] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.738785 10783 raft_consensus.cc:374] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:00:25.738891 10783 raft_consensus.cc:729] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb8211b53c44b879d48d5555c067d96, State: Initialized, Role: FOLLOWER
I20260809 19:00:25.739444 10783 consensus_queue.cc:260] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.740960 10783 ts_tablet_manager.cc:1428] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260809 19:00:25.851141 10747 tablet.cc:2369] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:00:25.886770 10535 tablet.cc:2369] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:00:25.946653 10326 tablet.cc:2369] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:00:25.965276 10792 raft_consensus.cc:482] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:00:25.965556 10792 raft_consensus.cc:504] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.967533 10792 leader_election.cc:288] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d60d09ce86c4ecd92e619ce8fa0d90f (127.16.188.195:41809), bb7837a3630f4a379e1b5d5bc2e10f6e (127.16.188.194:34199)
I20260809 19:00:25.973623 10764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.967835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:47525 (local address 127.16.188.195:41809)
0809 19:00:25.968015 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.968019 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.968510 (+ 491us) server_negotiation.cc:407] Connection header received
0809 19:00:25.968743 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.968750 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.968834 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.968931 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:25.969535 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.970249 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.971964 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.972737 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.972881 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.972963 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.973251 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.973381 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:00:25.973678 10793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.967749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:41809 (local address 127.16.188.193:47525)
0809 19:00:25.968399 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.968423 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:25.968563 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:25.968966 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:25.968971 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:25.969002 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:25.969395 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.969405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.970396 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.970400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.971815 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.971827 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.972939 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.972945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.973078 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.973135 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 19:00:25.973215 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 19:00:25.973337 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":341,"threads_started":1}
I20260809 19:00:25.974068 10771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.968798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:43307 (local address 127.16.188.194:34199)
0809 19:00:25.969006 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:25.969013 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:25.969282 (+ 269us) server_negotiation.cc:407] Connection header received
0809 19:00:25.969453 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:25.969458 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:25.969516 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:25.969586 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:00:25.970088 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.970771 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.972399 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.973207 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.973343 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.973413 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:25.973709 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 19:00:25.973829 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:00:25.974130 10794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:25.968517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:34199 (local address 127.16.188.193:43307)
0809 19:00:25.969179 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:25.969200 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:00:25.969321 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:00:25.969619 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:00:25.969623 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:00:25.969648 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:00:25.969949 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.969957 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.970897 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.970903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.972249 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:00:25.972262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:00:25.973412 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:00:25.973418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:00:25.973556 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:25.973580 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 19:00:25.973671 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 19:00:25.973795 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":491,"threads_started":1}
I20260809 19:00:25.974885 10671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "236334c106fe44989210650080a42037" candidate_uuid: "5eb8211b53c44b879d48d5555c067d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" is_pre_election: true
I20260809 19:00:25.975117 10463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "236334c106fe44989210650080a42037" candidate_uuid: "5eb8211b53c44b879d48d5555c067d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" is_pre_election: true
I20260809 19:00:25.975353 10671 raft_consensus.cc:2454] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb8211b53c44b879d48d5555c067d96 in term 0.
I20260809 19:00:25.975580 10463 raft_consensus.cc:2454] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb8211b53c44b879d48d5555c067d96 in term 0.
I20260809 19:00:25.975997 10148 leader_election.cc:302] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d60d09ce86c4ecd92e619ce8fa0d90f, 5eb8211b53c44b879d48d5555c067d96; no voters:
I20260809 19:00:25.976392 10792 raft_consensus.cc:2781] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:00:25.976524 10792 raft_consensus.cc:482] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:00:25.976629 10792 raft_consensus.cc:3037] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:25.978781 10792 raft_consensus.cc:504] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.979315 10792 leader_election.cc:288] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [CANDIDATE]: Term 1 election: Requested vote from peers 1d60d09ce86c4ecd92e619ce8fa0d90f (127.16.188.195:41809), bb7837a3630f4a379e1b5d5bc2e10f6e (127.16.188.194:34199)
I20260809 19:00:25.979765 10671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "236334c106fe44989210650080a42037" candidate_uuid: "5eb8211b53c44b879d48d5555c067d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f"
I20260809 19:00:25.979769 10463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "236334c106fe44989210650080a42037" candidate_uuid: "5eb8211b53c44b879d48d5555c067d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e"
I20260809 19:00:25.979930 10463 raft_consensus.cc:3037] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:25.979945 10671 raft_consensus.cc:3037] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:00:25.982072 10463 raft_consensus.cc:2454] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb8211b53c44b879d48d5555c067d96 in term 1.
I20260809 19:00:25.982178 10671 raft_consensus.cc:2454] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb8211b53c44b879d48d5555c067d96 in term 1.
I20260809 19:00:25.982425 10148 leader_election.cc:302] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb8211b53c44b879d48d5555c067d96, bb7837a3630f4a379e1b5d5bc2e10f6e; no voters:
I20260809 19:00:25.982712 10792 raft_consensus.cc:2781] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:00:25.983110 10792 raft_consensus.cc:686] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb8211b53c44b879d48d5555c067d96, State: Running, Role: LEADER
I20260809 19:00:25.983549 10792 consensus_queue.cc:237] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } }
I20260809 19:00:25.988082 10026 catalog_manager.cc:5495] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb8211b53c44b879d48d5555c067d96 (127.16.188.193). New cstate: current_term: 1 leader_uuid: "5eb8211b53c44b879d48d5555c067d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb8211b53c44b879d48d5555c067d96" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260809 19:00:26.049881 10767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.045061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58262 (local address 127.16.188.193:40315)
0809 19:00:26.045251 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:26.045256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:26.045273 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:00:26.045422 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:26.045425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:26.045513 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:26.045651 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:00:26.045968 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:26.046710 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:26.048011 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:26.048398 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:26.048487 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:26.048898 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:00:26.049435 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:00:26.049550 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:26.049610 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 19:00:26.049677 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:00:26.057643 10463 raft_consensus.cc:1261] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 FOLLOWER]: Refusing update from remote peer 5eb8211b53c44b879d48d5555c067d96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:26.057643 10671 raft_consensus.cc:1261] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 1 FOLLOWER]: Refusing update from remote peer 5eb8211b53c44b879d48d5555c067d96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:00:26.058558 10795 consensus_queue.cc:1035] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:26.058923 10792 consensus_queue.cc:1035] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:00:26.069597 10800 mvcc.cc:205] Tried to move back new op lower bound from 7316693098722697216 to 7316693098431971328. Current Snapshot: MvccSnapshot[applied={T|T < 7316693098722697216}]
I20260809 19:00:26.082144 10026 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:26.082409 10026 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:00:26.085671 10026 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Sending DeleteTablet for 3 replicas of tablet 236334c106fe44989210650080a42037
I20260809 19:00:26.086777 10215 tablet_service.cc:1514] Processing DeleteTablet for tablet 236334c106fe44989210650080a42037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:26 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:58258
I20260809 19:00:26.086899 10640 tablet_service.cc:1514] Processing DeleteTablet for tablet 236334c106fe44989210650080a42037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:26 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:33788
I20260809 19:00:26.086947 10433 tablet_service.cc:1514] Processing DeleteTablet for tablet 236334c106fe44989210650080a42037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:00:26 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:48974
I20260809 19:00:26.087831 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 10082
I20260809 19:00:26.099275 10813 tablet_replica.cc:330] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: stopping tablet replica
I20260809 19:00:26.099902 10813 raft_consensus.cc:2229] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:00:26.100719 10813 raft_consensus.cc:2258] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:26.103240 10813 ts_tablet_manager.cc:1905] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:26.112764 10816 tablet_replica.cc:330] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: stopping tablet replica
I20260809 19:00:26.113247 10816 raft_consensus.cc:2229] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:26.113498 10767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.089451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58272 (local address 127.16.188.193:40315)
0809 19:00:26.089644 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:26.089650 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:26.089673 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:00:26.089937 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:26.089943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:26.090051 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:26.090147 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:26.092274 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:26.093637 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:26.095829 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:26.096572 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:26.096704 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:26.104777 (+ 8073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:26.104796 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:26.104813 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:26.104860 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:26.109201 (+ 4341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:26.110114 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:26.110125 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:26.110129 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:26.110327 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:26.110840 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:26.110845 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:26.110849 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:26.111306 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:26.111637 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:26.112852 (+ 1215us) server_negotiation.cc:299] Negotiation successful
0809 19:00:26.113123 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:00:26.113795 10816 raft_consensus.cc:2258] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:26.114243 10317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:00:26.114579 10815 tablet_replica.cc:330] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: stopping tablet replica
I20260809 19:00:26.115013 10815 raft_consensus.cc:2229] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:00:26.115836 10815 raft_consensus.cc:2258] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:00:26.117349 10816 ts_tablet_manager.cc:1905] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:26.117702 10815 ts_tablet_manager.cc:1905] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:26.122318 10815 ts_tablet_manager.cc:1918] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:26.122504 10815 log.cc:1196] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/236334c106fe44989210650080a42037
I20260809 19:00:26.123008 10815 ts_tablet_manager.cc:1939] T 236334c106fe44989210650080a42037 P 1d60d09ce86c4ecd92e619ce8fa0d90f: Deleting consensus metadata
I20260809 19:00:26.124472 10816 ts_tablet_manager.cc:1918] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:26.124899 10816 log.cc:1196] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/236334c106fe44989210650080a42037
I20260809 19:00:26.124841 10011 catalog_manager.cc:4841] TS 1d60d09ce86c4ecd92e619ce8fa0d90f (127.16.188.195:41809): tablet 236334c106fe44989210650080a42037 (table test-table [id=1a1bdebc43b946d79c93c21bf5e45bc5]) successfully deleted
I20260809 19:00:26.125383 10816 ts_tablet_manager.cc:1939] T 236334c106fe44989210650080a42037 P bb7837a3630f4a379e1b5d5bc2e10f6e: Deleting consensus metadata
I20260809 19:00:26.126698 10011 catalog_manager.cc:4841] TS bb7837a3630f4a379e1b5d5bc2e10f6e (127.16.188.194:34199): tablet 236334c106fe44989210650080a42037 (table test-table [id=1a1bdebc43b946d79c93c21bf5e45bc5]) successfully deleted
I20260809 19:00:26.216424 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 10082
I20260809 19:00:26.248278 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 10329
W20260809 19:00:26.248293 10006 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.188.193:40315 (error 108)
I20260809 19:00:26.250387 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.249728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:58276)
0809 19:00:26.250129 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.250220 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":207,"threads_started":1}
W20260809 19:00:26.250597 10006 catalog_manager.cc:4584] TS 5eb8211b53c44b879d48d5555c067d96 (127.16.188.193:40315): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 236334c106fe44989210650080a42037: Network error: Client connection negotiation failed: client connection to 127.16.188.193:40315: connect: Connection refused (error 111)
I20260809 19:00:26.266614 10771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.249153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48984 (local address 127.16.188.194:34199)
0809 19:00:26.249359 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:26.249364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:26.249389 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:00:26.249569 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:26.249574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:26.249655 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:26.249764 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:26.251374 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:26.252105 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:26.253633 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:26.254048 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:26.254170 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:26.260729 (+ 6559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:26.260743 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:26.260760 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:26.260795 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:26.263513 (+ 2718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:26.264250 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:26.264258 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:26.264261 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:26.264415 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:26.264806 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:26.264810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:26.264812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:26.265362 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:26.265679 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:26.266015 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 19:00:26.266244 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 19:00:26.267243 10521 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:00:26.304212 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.303746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:58280)
0809 19:00:26.303955 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.304068 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 19:00:26.305287 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.304888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:58290)
0809 19:00:26.305049 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.305157 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 19:00:26.354188 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 10329
I20260809 19:00:26.366142 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.365589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:58302)
0809 19:00:26.365821 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.365934 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 19:00:26.367199 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.366793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:58314)
0809 19:00:26.366935 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.367033 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 19:00:26.380159 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 10539
I20260809 19:00:26.393083 10764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.380921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33796 (local address 127.16.188.195:41809)
0809 19:00:26.381141 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 19:00:26.381147 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:00:26.381169 (+ 22us) server_negotiation.cc:407] Connection header received
0809 19:00:26.381307 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:00:26.381312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:00:26.381378 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:00:26.381463 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:00:26.382737 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:26.383445 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:26.384739 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:00:26.385202 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:00:26.385322 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:00:26.387818 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:00:26.387835 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:00:26.387854 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:00:26.387897 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:00:26.390361 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:26.391036 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:26.391043 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:26.391046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:26.391215 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:00:26.391589 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:00:26.391592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:00:26.391594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:00:26.391955 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:00:26.392249 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0809 19:00:26.392525 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 19:00:26.392743 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:00:26.393785 10740 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:00:26.447662 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.447201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:58316)
0809 19:00:26.447414 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.447512 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 19:00:26.448760 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:26.448362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:40315 (local address 127.0.0.1:58330)
0809 19:00:26.448545 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:26.448621 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260809 19:00:26.482156 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 10539
I20260809 19:00:26.503242 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 9984
I20260809 19:00:26.504403 10070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:00:26.616196 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 9984
I20260809 19:00:46.645040 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:37119
--webserver_interface=127.16.188.254
--webserver_port=46147
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:37119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:47.002419 10828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:47.002738 10828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:47.002897 10828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:47.010499 10828 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 19:00:47.010636 10828 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 19:00:47.010707 10828 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 19:00:47.010788 10828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:00:47.010872 10828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:47.010985 10828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:47.011057 10828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:00:47.011143 10828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:00:47.021193 10828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:37119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:37119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=46147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:47.022485 10828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:47.023957 10828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:47.036144 10844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:47.036103 10839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:47.036181 10838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:47.036806 10828 server_base.cc:1034] running on GCE node
I20260809 19:00:47.037626 10828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:47.039008 10828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:47.040233 10828 hybrid_clock.cc:648] HybridClock initialized: now 1786302047040174 us; error 37 us; skew 500 ppm
I20260809 19:00:47.040553 10828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:47 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302047, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:47.043629 10828 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:00:47.045018 10828 webserver.cc:460] Webserver started at http://127.16.188.254:46147/ using document root <none> and password file <none>
I20260809 19:00:47.045696 10828 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:47.045786 10828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:47.050909 10828 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 19:00:47.053550 10853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:47.054888 10828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 19:00:47.055049 10828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "9fbf8c3d7bea4591842115458520485c"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "7f3041255daad660f1ed54081ef261c4"
server_key_iv: "89c63cd8e1d48ff2f9e3e8d9d5665592"
server_key_version: "encryptionkey@0"
I20260809 19:00:47.055979 10828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:47.082683 10828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:47.086611 10828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:47.086843 10828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:47.103554 10828 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:37119
I20260809 19:00:47.103575 10941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:37119 every 8 connection(s)
I20260809 19:00:47.105212 10828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:00:47.105638 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 10828
I20260809 19:00:47.106600 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:40315
--local_ip_for_outbound_sockets=127.16.188.193
--tserver_master_addrs=127.16.188.254:37119
--webserver_port=37257
--webserver_interface=127.16.188.193
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:00:47.112284 10943 sys_catalog.cc:263] Verifying existing consensus state
I20260809 19:00:47.115474 10943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Bootstrap starting.
I20260809 19:00:47.135887 10943 log.cc:824] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Log is configured to *not* fsync() on all Append() calls
I20260809 19:00:47.151805 10943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 19:00:47.152294 10943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Bootstrap complete.
I20260809 19:00:47.161446 10943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:47.162329 10943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbf8c3d7bea4591842115458520485c, State: Initialized, Role: FOLLOWER
I20260809 19:00:47.162940 10943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:47.163170 10943 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:00:47.163290 10943 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:00:47.163455 10943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 2 FOLLOWER]: Advancing to term 3
I20260809 19:00:47.168634 10943 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:47.169121 10943 leader_election.cc:302] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fbf8c3d7bea4591842115458520485c; no voters:
I20260809 19:00:47.169768 10943 leader_election.cc:288] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 19:00:47.169914 10951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 3 FOLLOWER]: Leader election won for term 3
I20260809 19:00:47.170975 10951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [term 3 LEADER]: Becoming Leader. State: Replica: 9fbf8c3d7bea4591842115458520485c, State: Running, Role: LEADER
I20260809 19:00:47.171582 10951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } }
I20260809 19:00:47.171943 10943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:00:47.174053 10954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fbf8c3d7bea4591842115458520485c. Latest consensus state: current_term: 3 leader_uuid: "9fbf8c3d7bea4591842115458520485c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } } }
I20260809 19:00:47.174399 10954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:47.174865 10952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9fbf8c3d7bea4591842115458520485c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fbf8c3d7bea4591842115458520485c" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 37119 } } }
I20260809 19:00:47.175170 10952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c [sys.catalog]: This master's current role is: LEADER
I20260809 19:00:47.185316 10958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:00:47.194751 10958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:00:47.196524 10958 catalog_manager.cc:1259] Loaded cluster ID: 2262be319dfc4192826e99f220872ce6
I20260809 19:00:47.196671 10958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:00:47.200879 10958 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:00:47.202615 10958 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Loaded TSK: 0
I20260809 19:00:47.202841 10958 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9fbf8c3d7bea4591842115458520485c: Loaded TSK: 1
F20260809 19:00:47.204118 10958 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1e29e539ad google::LogMessage::Fail() at ??:0
@ 0x7f1e29e5688a google::LogMessage::SendToLog() at ??:0
@ 0x7f1e29e534de google::LogMessage::Flush() at ??:0
@ 0x7f1e29e54a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1e2dbb77d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1e2dba673e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1e3f8821c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1e3f881783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1e3f90d2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f1e3f90d0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f1e3f9575e9 std::function<>::operator()() at ??:0
@ 0x7f1e3f885cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f1e3f883c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1e3f90b610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f1e3f90b439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f1e2ca9f345 kudu::ThreadPool::DispatchThread() at ??:0
I20260809 19:00:47.305159 10981 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f1e2caa291c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f1e2caa2799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f1e2ca7deaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1e2fd576db start_thread at ??:0
@ 0x7f1e28ced61f clone at ??:0
W20260809 19:00:47.525491 10945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:47.525763 10945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:47.525902 10945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:47.532984 10945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:47.533118 10945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:47.533268 10945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:00:47.542757 10945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:40315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=37257
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:47.544004 10945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:47.545306 10945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:47.557909 11017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:47.557950 11014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:47.557977 11013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:47.559000 10945 server_base.cc:1034] running on GCE node
I20260809 19:00:47.559549 10945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:47.560446 10945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:47.561658 10945 hybrid_clock.cc:648] HybridClock initialized: now 1786302047561611 us; error 36 us; skew 500 ppm
I20260809 19:00:47.561954 10945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:47 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302047, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:47.568951 10945 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 19:00:47.570333 10945 webserver.cc:460] Webserver started at http://127.16.188.193:37257/ using document root <none> and password file <none>
I20260809 19:00:47.570953 10945 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:47.571055 10945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:47.576216 10945 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 19:00:47.579144 11027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:47.580432 10945 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:00:47.580593 10945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "5eb8211b53c44b879d48d5555c067d96"
format_stamp: "Formatted at 2026-08-09 19:00:01 on dist-test-slave-266d"
server_key: "52bbdc09936ab6d1ca20237bad500fe6"
server_key_iv: "742fa8cc5c4f221f300aea300bf608f7"
server_key_version: "encryptionkey@0"
I20260809 19:00:47.581524 10945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:47.608966 10945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:47.612811 10945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:47.613039 10945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:47.614027 10945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:47.615813 11042 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260809 19:00:47.621124 11042 ts_tablet_manager.cc:1852] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260809 19:00:47.622126 11042 ts_tablet_manager.cc:1905] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:00:47.629386 11042 ts_tablet_manager.cc:1918] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:00:47.629581 11042 log.cc:1196] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/236334c106fe44989210650080a42037
I20260809 19:00:47.630035 11042 ts_tablet_manager.cc:1939] T 236334c106fe44989210650080a42037 P 5eb8211b53c44b879d48d5555c067d96: Deleting consensus metadata
I20260809 19:00:47.630420 10945 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260809 19:00:47.630553 10945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20260809 19:00:47.630705 10945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:47.630784 10945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:47.664780 10945 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:40315
I20260809 19:00:47.664824 11223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:40315 every 8 connection(s)
I20260809 19:00:47.666258 10945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:00:47.671463 11230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:47.669501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:58219)
0809 19:00:47.670285 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:47.670525 (+ 240us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":278,"threads_started":1}
W20260809 19:00:47.672204 11225 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:37119 (0 consecutive failures): Network error: Failed to ping master at 127.16.188.254:37119: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
I20260809 19:00:47.673157 11230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:47.672757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:54563)
0809 19:00:47.672921 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:47.673002 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 19:00:47.674011 11230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:47.673696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:32895)
0809 19:00:47.673814 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:47.673890 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:00:47.674240 11225 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:00:47.675860 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 10945
I20260809 19:00:47.676527 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:34199
--local_ip_for_outbound_sockets=127.16.188.194
--tserver_master_addrs=127.16.188.254:37119
--webserver_port=34977
--webserver_interface=127.16.188.194
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:48.016386 11233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:48.016652 11233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:48.016754 11233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:48.023746 11233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:48.023849 11233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:48.023963 11233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:00:48.033341 11233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:34199
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=34977
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:48.034541 11233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:48.035784 11233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:48.048074 11243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:48.048146 11239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:48.048117 11240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:48.048832 11233 server_base.cc:1034] running on GCE node
I20260809 19:00:48.049407 11233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:48.050240 11233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:48.051430 11233 hybrid_clock.cc:648] HybridClock initialized: now 1786302048051379 us; error 45 us; skew 500 ppm
I20260809 19:00:48.051702 11233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:48 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302048, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:48.054626 11233 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 19:00:48.055912 11233 webserver.cc:460] Webserver started at http://127.16.188.194:34977/ using document root <none> and password file <none>
I20260809 19:00:48.056546 11233 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:48.056648 11233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:48.061661 11233 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:00:48.064198 11252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:48.065600 11233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:00:48.065745 11233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "bb7837a3630f4a379e1b5d5bc2e10f6e"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "005e317c1c8f97c22afb11ae0b4344d2"
server_key_iv: "95079513cf176c09fc48885136121bfe"
server_key_version: "encryptionkey@0"
I20260809 19:00:48.066656 11233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:48.088999 11233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:48.093146 11233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:48.093448 11233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:48.094390 11233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:48.095696 11233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:48.095783 11233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:48.095862 11233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:48.095917 11233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:48.124605 11233 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:34199
I20260809 19:00:48.124681 11427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:34199 every 8 connection(s)
I20260809 19:00:48.126034 11233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:00:48.130574 11430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.128806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:59193)
0809 19:00:48.129529 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:48.129763 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":301,"threads_started":1}
W20260809 19:00:48.131175 11428 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:37119 (0 consecutive failures): Network error: Failed to ping master at 127.16.188.254:37119: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
I20260809 19:00:48.131892 11430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.131605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:34331)
0809 19:00:48.131727 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:48.131791 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 19:00:48.132582 11430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.132317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:58193)
0809 19:00:48.132417 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:48.132485 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 19:00:48.132782 11428 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:00:48.136060 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 11233
I20260809 19:00:48.136677 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:41809
--local_ip_for_outbound_sockets=127.16.188.195
--tserver_master_addrs=127.16.188.254:37119
--webserver_port=44763
--webserver_interface=127.16.188.195
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:00:48.464659 11431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:00:48.464933 11431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:00:48.465080 11431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:00:48.472136 11431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:00:48.472250 11431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:00:48.472401 11431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:00:48.481989 11431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:41809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=44763
--tserver_master_addrs=127.16.188.254:37119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:00:48.483299 11431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:00:48.484642 11431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:00:48.497519 11441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:48.497632 11437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:00:48.497571 11438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:00:48.498633 11431 server_base.cc:1034] running on GCE node
I20260809 19:00:48.499197 11431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:00:48.500099 11431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:00:48.501302 11431 hybrid_clock.cc:648] HybridClock initialized: now 1786302048501256 us; error 39 us; skew 500 ppm
I20260809 19:00:48.501593 11431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:00:48 dist-test-slave-266d krb5kdc[9094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302048, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:00:48.504745 11431 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 19:00:48.506641 11431 webserver.cc:460] Webserver started at http://127.16.188.195:44763/ using document root <none> and password file <none>
I20260809 19:00:48.507469 11431 fs_manager.cc:359] Metadata directory not provided
I20260809 19:00:48.507603 11431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:00:48.512893 11431 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:00:48.515569 11453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:48.516839 11431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:00:48.517009 11431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "1d60d09ce86c4ecd92e619ce8fa0d90f"
format_stamp: "Formatted at 2026-08-09 19:00:02 on dist-test-slave-266d"
server_key: "8f4df408d4b9ac118babd444306f911a"
server_key_iv: "89a2515a9d326c88053b4d702c7ccd89"
server_key_version: "encryptionkey@0"
I20260809 19:00:48.518024 11431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:00:48.533318 11431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:00:48.537019 11431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:00:48.537326 11431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:00:48.538268 11431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:00:48.539594 11431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:00:48.539716 11431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:48.539830 11431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:00:48.539917 11431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:00:48.571906 11431 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:41809
I20260809 19:00:48.571965 11648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:41809 every 8 connection(s)
I20260809 19:00:48.573477 11431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:00:48.578179 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.576297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:56395)
0809 19:00:48.577081 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:48.577345 (+ 264us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":311,"threads_started":1}
W20260809 19:00:48.578805 11649 heartbeater.cc:644] Failed to heartbeat to 127.16.188.254:37119 (0 consecutive failures): Network error: Failed to ping master at 127.16.188.254:37119: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
I20260809 19:00:48.579571 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.579273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:59339)
0809 19:00:48.579398 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:48.579471 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 19:00:48.580400 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.580088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:53097)
0809 19:00:48.580224 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:48.580296 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 19:00:48.580647 11649 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 19:00:48.581900 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 11431
I20260809 19:00:48.675595 11654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:48.674755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:49339)
0809 19:00:48.675252 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:48.675351 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":234,"threads_started":1}
I20260809 19:00:49.134121 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:49.133337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:39553)
0809 19:00:49.133783 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:49.133871 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":209,"threads_started":1}
I20260809 19:00:49.581890 11656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:49.581128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:58177)
0809 19:00:49.581555 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:49.581666 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":203,"threads_started":1}
I20260809 19:00:49.677219 11657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:49.676465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:45601)
0809 19:00:49.676945 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:49.677032 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":250,"threads_started":1}
I20260809 19:00:50.135627 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:50.134940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:60333)
0809 19:00:50.135393 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:50.135470 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":213,"threads_started":1}
I20260809 19:00:50.583438 11661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:50.582725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:58481)
0809 19:00:50.583194 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:50.583275 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":249,"threads_started":1}
I20260809 19:00:50.678972 11662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:50.678158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:43489)
0809 19:00:50.678676 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:50.678776 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":242,"threads_started":1}
I20260809 19:00:51.137081 11663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:51.136413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:46567)
0809 19:00:51.136827 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:51.136905 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":217,"threads_started":1}
I20260809 19:00:51.584961 11664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:51.584217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:50959)
0809 19:00:51.584705 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:51.584796 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":286,"threads_started":1}
I20260809 19:00:51.680474 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:51.679743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:59013)
0809 19:00:51.680227 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:51.680311 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":240,"threads_started":1}
I20260809 19:00:52.138692 11669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:52.137974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:34179)
0809 19:00:52.138413 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:52.138491 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":230,"threads_started":1}
I20260809 19:00:52.586474 11670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:52.585752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:50667)
0809 19:00:52.586196 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:52.586276 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":203,"threads_started":1}
I20260809 19:00:52.682003 11671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:52.681295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:42011)
0809 19:00:52.681759 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:52.681839 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":223,"threads_started":1}
I20260809 19:00:53.140446 11672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:53.139702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:54647)
0809 19:00:53.140182 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:53.140265 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":243,"threads_started":1}
I20260809 19:00:53.588023 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:53.587324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:36381)
0809 19:00:53.587776 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:53.587856 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":224,"threads_started":1}
I20260809 19:00:53.683635 11675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:53.682893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:35943)
0809 19:00:53.683354 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:53.683443 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":244,"threads_started":1}
I20260809 19:00:54.141947 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:54.141250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:35853)
0809 19:00:54.141683 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:54.141785 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":223,"threads_started":1}
I20260809 19:00:54.589495 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:54.588791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:46647)
0809 19:00:54.589242 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:54.589329 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":208,"threads_started":1}
I20260809 19:00:54.685375 11678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:54.684512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:50935)
0809 19:00:54.685027 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:54.685145 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":241,"threads_started":1}
I20260809 19:00:55.143646 11682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:55.142875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:50489)
0809 19:00:55.143349 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:55.143429 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":198,"threads_started":1}
I20260809 19:00:55.591101 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:55.590323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:37697)
0809 19:00:55.590807 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:55.590885 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":197,"threads_started":1}
I20260809 19:00:55.686823 11684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:55.686168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:52225)
0809 19:00:55.686571 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:55.686663 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":213,"threads_started":1}
I20260809 19:00:56.145177 11688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:56.144463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:58977)
0809 19:00:56.144886 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:56.144970 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":224,"threads_started":1}
I20260809 19:00:56.592664 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:56.591939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:38825)
0809 19:00:56.592410 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:56.592495 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":242,"threads_started":1}
I20260809 19:00:56.688277 11691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:56.687566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:33473)
0809 19:00:56.688011 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:56.688111 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":213,"threads_started":1}
I20260809 19:00:57.146700 11692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:57.146003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:59831)
0809 19:00:57.146453 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:57.146530 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":228,"threads_started":1}
I20260809 19:00:57.594216 11694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:57.593516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:58071)
0809 19:00:57.593950 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:57.594028 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":211,"threads_started":1}
I20260809 19:00:57.689880 11696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:57.689210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:59595)
0809 19:00:57.689624 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:57.689703 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":206,"threads_started":1}
I20260809 19:00:58.148460 11701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:58.147653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:43435)
0809 19:00:58.148213 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:58.148295 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":285,"threads_started":1}
I20260809 19:00:58.595782 11702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:58.595058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:59859)
0809 19:00:58.595518 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:58.595610 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":250,"threads_started":1}
I20260809 19:00:58.691452 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:58.690698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:41921)
0809 19:00:58.691177 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:58.691255 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":282,"threads_started":1}
I20260809 19:00:59.150035 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:59.149332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:44321)
0809 19:00:59.149769 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:59.149859 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":224,"threads_started":1}
I20260809 19:00:59.597510 11707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:59.596753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:33443)
0809 19:00:59.597239 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:59.597330 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":231,"threads_started":1}
I20260809 19:00:59.692893 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:00:59.692260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:35861)
0809 19:00:59.692658 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 19:00:59.692737 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":211,"threads_started":1}
I20260809 19:01:00.151511 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:00.150867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:34941)
0809 19:01:00.151280 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:00.151358 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":200,"threads_started":1}
I20260809 19:01:00.598937 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:00.598305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:46309)
0809 19:01:00.598707 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:00.598788 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":201,"threads_started":1}
I20260809 19:01:00.694655 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:00.693846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:43199)
0809 19:01:00.694352 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:00.694457 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":257,"threads_started":1}
I20260809 19:01:01.153079 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:01.152309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:51341)
0809 19:01:01.152803 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:01.152894 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":233,"threads_started":1}
I20260809 19:01:01.600484 11715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:01.599693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:55423)
0809 19:01:01.600193 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:01.600301 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":267,"threads_started":1}
I20260809 19:01:01.696100 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:01.695425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:33945)
0809 19:01:01.695838 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:01.695925 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":202,"threads_started":1}
I20260809 19:01:02.154764 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:02.153967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:46539)
0809 19:01:02.154440 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:02.154541 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":239,"threads_started":1}
I20260809 19:01:02.601945 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:02.601283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:42163)
0809 19:01:02.601695 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:02.601773 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":216,"threads_started":1}
I20260809 19:01:02.697911 11721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:02.697167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.193:36127)
0809 19:01:02.697608 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:02.697729 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":216,"threads_started":1}
I20260809 19:01:03.156534 11722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:03.155798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.194:34041)
0809 19:01:03.156214 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:03.156356 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":215,"threads_started":1}
I20260809 19:01:03.583441 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 10945
I20260809 19:01:03.603037 11724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:03.584527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45300 (local address 127.16.188.193:40315)
0809 19:01:03.585354 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:03.585375 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:03.585429 (+ 54us) server_negotiation.cc:407] Connection header received
0809 19:01:03.587369 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:03.587379 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:03.587823 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:03.588176 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:03.589843 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:03.591234 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:03.592623 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:03.593354 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:03.593555 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:03.596439 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:03.596449 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:03.596464 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:03.596509 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:03.599421 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:03.600134 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:03.600142 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:03.600149 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:03.600343 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:03.600758 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:03.600763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:03.600765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:03.601382 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:03.601697 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:03.602183 (+ 486us) server_negotiation.cc:299] Negotiation successful
0809 19:01:03.602600 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":446,"threads_started":1}
I20260809 19:01:03.604171 11725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:03.603026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:37119 (local address 127.16.188.195:34921)
0809 19:01:03.603849 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:03.603964 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.254:37119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":552,"threads_started":1}
I20260809 19:01:03.604708 11215 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:03.687031 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 10945
I20260809 19:01:03.714108 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 11233
I20260809 19:01:03.732016 11729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:03.714978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35370 (local address 127.16.188.194:34199)
0809 19:01:03.715548 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:03.715562 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:03.715599 (+ 37us) server_negotiation.cc:407] Connection header received
0809 19:01:03.717214 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:03.717225 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:03.717636 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:03.717962 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:03.719428 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:03.720659 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:03.722076 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:03.722773 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:03.722938 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:03.725850 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:03.725859 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:03.725873 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:03.725914 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:03.728624 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:03.729377 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:03.729387 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:03.729393 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:03.729589 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:03.730016 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:03.730020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:03.730022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:03.730537 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:03.730858 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:03.731321 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 19:01:03.731721 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":277,"threads_started":1}
I20260809 19:01:03.733347 11422 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:03.814553 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 11233
I20260809 19:01:03.841562 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 11431
I20260809 19:01:03.859637 11732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:03.842893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41740 (local address 127.16.188.195:41809)
0809 19:01:03.843712 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:03.843731 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:03.843795 (+ 64us) server_negotiation.cc:407] Connection header received
0809 19:01:03.845533 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:03.845543 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:03.845976 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:03.846289 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:03.847800 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:03.849015 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:03.850272 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:03.850904 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:03.851068 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:03.853799 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:03.853807 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:03.853822 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:03.853863 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:03.856417 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:03.857058 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:03.857065 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:03.857071 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:03.857357 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:03.857717 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:03.857722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:03.857726 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:03.858229 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:03.858499 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:03.858944 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 19:01:03.859333 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":464,"threads_started":1}
I20260809 19:01:03.860906 11641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:03.944978 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 11431
2026-08-09T19:01:03Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64598 ms)
[----------] 30 tests from SecurityITest (298190 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:04 dist-test-slave-266d krb5kdc[11738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:04 dist-test-slave-266d krb5kdc[11738](info): set up 2 sockets
Aug 09 19:01:04 dist-test-slave-266d krb5kdc[11738](info): commencing operation
krb5kdc: starting...
W20260809 19:01:05.204732 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.002s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:05 dist-test-slave-266d krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:01:05.497622 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:33965
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:33965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:05.831669 11753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:05.831936 11753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:05.832031 11753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:05.838912 11753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:05.839074 11753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:05.839154 11753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:05.839267 11753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:05.839326 11753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:05.850323 11753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:33965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:33965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:05.851524 11753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:05.852774 11753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:05.864483 11763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:05.864544 11759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:05.864521 11767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:05.870466 11753 server_base.cc:1034] running on GCE node
I20260809 19:01:05.871258 11753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:05.872709 11753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:05.873908 11753 hybrid_clock.cc:648] HybridClock initialized: now 1786302065873859 us; error 32 us; skew 500 ppm
I20260809 19:01:05.874256 11753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:05 dist-test-slave-266d krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:05.877290 11753 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:01:05.878763 11753 webserver.cc:460] Webserver started at http://127.16.188.254:34623/ using document root <none> and password file <none>
I20260809 19:01:05.879459 11753 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:05.879578 11753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:05.879873 11753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:05.882850 11753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "f5cbaa01d113460f8aad7b781ce105e4"
format_stamp: "Formatted at 2026-08-09 19:01:05 on dist-test-slave-266d"
server_key: "636a516d0eb2bbcb958b5845d0c6225c"
server_key_iv: "d396324bf12a46d38ff4970f5c82e294"
server_key_version: "encryptionkey@0"
I20260809 19:01:05.883591 11753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "f5cbaa01d113460f8aad7b781ce105e4"
format_stamp: "Formatted at 2026-08-09 19:01:05 on dist-test-slave-266d"
server_key: "636a516d0eb2bbcb958b5845d0c6225c"
server_key_iv: "d396324bf12a46d38ff4970f5c82e294"
server_key_version: "encryptionkey@0"
I20260809 19:01:05.888504 11753 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:01:05.891716 11781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:05.892920 11753 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 19:01:05.893083 11753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "f5cbaa01d113460f8aad7b781ce105e4"
format_stamp: "Formatted at 2026-08-09 19:01:05 on dist-test-slave-266d"
server_key: "636a516d0eb2bbcb958b5845d0c6225c"
server_key_iv: "d396324bf12a46d38ff4970f5c82e294"
server_key_version: "encryptionkey@0"
I20260809 19:01:05.893294 11753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:05.917683 11753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:05.921455 11753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:05.921705 11753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:05.938598 11753 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:33965
I20260809 19:01:05.938620 11878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:33965 every 8 connection(s)
I20260809 19:01:05.939864 11753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:05.940708 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 11753
I20260809 19:01:05.940953 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:05.941655 17139 external_mini_cluster.cc:1428] Setting key 49407b47249891e1bfa1726ffaec0876
I20260809 19:01:05.943915 11879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 19:01:05 dist-test-slave-266d krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:05.956403 11879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4: Bootstrap starting.
I20260809 19:01:05.959813 11879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:05.960860 11879 log.cc:824] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:05.963903 11879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4: No bootstrap required, opened a new log
I20260809 19:01:05.964666 11883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:05.943644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.16.188.254:33965)
0809 19:01:05.944449 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:05.944464 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:05.944513 (+ 49us) server_negotiation.cc:407] Connection header received
0809 19:01:05.946691 (+ 2178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:05.946717 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:05.947181 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:05.947614 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:05.948965 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:05.950966 (+ 2001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:05.952269 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:05.953297 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:05.953469 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:05.957617 (+ 4148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:05.957626 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:05.957638 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:05.957672 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:05.960605 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:05.961482 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:05.961491 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:05.961499 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:05.961733 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:05.962099 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:05.962104 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:05.962112 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:05.962625 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:05.962835 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:05.963334 (+ 499us) server_negotiation.cc:299] Negotiation successful
0809 19:01:05.963636 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":332,"threads_started":1}
I20260809 19:01:05.970993 11879 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cbaa01d113460f8aad7b781ce105e4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33965 } }
I20260809 19:01:05.971318 11879 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:05.971411 11879 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5cbaa01d113460f8aad7b781ce105e4, State: Initialized, Role: FOLLOWER
I20260809 19:01:05.972008 11879 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cbaa01d113460f8aad7b781ce105e4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33965 } }
I20260809 19:01:05.972229 11879 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:05.972424 11879 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:05.972589 11879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:05.974625 11879 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cbaa01d113460f8aad7b781ce105e4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33965 } }
I20260809 19:01:05.975055 11879 leader_election.cc:302] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5cbaa01d113460f8aad7b781ce105e4; no voters:
I20260809 19:01:05.975590 11879 leader_election.cc:288] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:05.975728 11885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:05.976541 11885 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [term 1 LEADER]: Becoming Leader. State: Replica: f5cbaa01d113460f8aad7b781ce105e4, State: Running, Role: LEADER
I20260809 19:01:05.977247 11885 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cbaa01d113460f8aad7b781ce105e4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33965 } }
I20260809 19:01:05.978677 11879 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:05.979035 11889 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5cbaa01d113460f8aad7b781ce105e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cbaa01d113460f8aad7b781ce105e4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33965 } } }
I20260809 19:01:05.979501 11889 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:05.980099 11887 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5cbaa01d113460f8aad7b781ce105e4. Latest consensus state: current_term: 1 leader_uuid: "f5cbaa01d113460f8aad7b781ce105e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cbaa01d113460f8aad7b781ce105e4" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33965 } } }
I20260809 19:01:05.980856 11887 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:05.982456 11891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:05.987370 11891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:05.995265 11891 catalog_manager.cc:1347] Generated new cluster ID: 0e2e2640a4c440378da7db61aab068ac
I20260809 19:01:05.995361 11891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:06.009982 11891 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:06.011857 11891 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:06.028803 11891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4: Generated new TSK 0
I20260809 19:01:06.029891 11891 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 19:01:06.096896 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33965
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:06.427707 11918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:06.427978 11918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:06.428114 11918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:06.435057 11918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:06.435176 11918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:06.435330 11918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:01:06.444519 11918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:06.445709 11918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:06.446964 11918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:06.460194 11928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:06.460170 11932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:06.460136 11929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:06.461367 11918 server_base.cc:1034] running on GCE node
I20260809 19:01:06.461947 11918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:06.462823 11918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:06.464039 11918 hybrid_clock.cc:648] HybridClock initialized: now 1786302066463974 us; error 56 us; skew 500 ppm
I20260809 19:01:06.464365 11918 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:06 dist-test-slave-266d krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302066, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:06.467423 11918 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 19:01:06.468750 11918 webserver.cc:460] Webserver started at http://127.16.188.193:44865/ using document root <none> and password file <none>
I20260809 19:01:06.469413 11918 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:06.469514 11918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:06.469801 11918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:06.472893 11918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "01f32fb49eb24b809dea2905ef60badb"
format_stamp: "Formatted at 2026-08-09 19:01:06 on dist-test-slave-266d"
server_key: "786e5e50bce9542238eff17c03e2f556"
server_key_iv: "2e98f3dbfd5dfaddf324c2b7a9b43949"
server_key_version: "encryptionkey@0"
I20260809 19:01:06.473688 11918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "01f32fb49eb24b809dea2905ef60badb"
format_stamp: "Formatted at 2026-08-09 19:01:06 on dist-test-slave-266d"
server_key: "786e5e50bce9542238eff17c03e2f556"
server_key_iv: "2e98f3dbfd5dfaddf324c2b7a9b43949"
server_key_version: "encryptionkey@0"
I20260809 19:01:06.478509 11918 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 19:01:06.481917 11943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:06.483119 11918 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 19:01:06.483258 11918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "01f32fb49eb24b809dea2905ef60badb"
format_stamp: "Formatted at 2026-08-09 19:01:06 on dist-test-slave-266d"
server_key: "786e5e50bce9542238eff17c03e2f556"
server_key_iv: "2e98f3dbfd5dfaddf324c2b7a9b43949"
server_key_version: "encryptionkey@0"
I20260809 19:01:06.483428 11918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:06.498592 11918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:06.502190 11918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:06.502435 11918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:06.503350 11918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:06.504576 11918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:06.504660 11918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:06.504777 11918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:06.504829 11918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:06.534276 11918 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:38357
I20260809 19:01:06.534312 12122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:38357 every 8 connection(s)
I20260809 19:01:06.535492 11918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:01:06.543011 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 11918
I20260809 19:01:06.543205 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 19:01:06.543977 17139 external_mini_cluster.cc:1428] Setting key 5244747a96c37e0812c5db5629c8df7c
Aug 09 19:01:06 dist-test-slave-266d krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302066, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:06.554494 12125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:06.537966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:36759 (local address 127.16.188.254:33965)
0809 19:01:06.538409 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:06.538413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:06.539284 (+ 871us) server_negotiation.cc:407] Connection header received
0809 19:01:06.540994 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:06.540998 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:06.541065 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:06.541204 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:06.542558 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:06.543404 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:06.545425 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:06.545897 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:06.546011 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:06.549286 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:06.549291 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:06.549294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:06.549324 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:06.551637 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:06.552289 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:06.552294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:06.552298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:06.552417 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:06.552818 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:06.552823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:06.552827 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:06.553119 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:06.553262 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:06.553923 (+ 661us) server_negotiation.cc:299] Negotiation successful
0809 19:01:06.554151 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":210,"threads_started":1}
I20260809 19:01:06.555392 12126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:06.538464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33965 (local address 127.16.188.193:36759)
0809 19:01:06.539137 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:06.539173 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:06.540758 (+ 1585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:06.541392 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:06.541399 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:06.541860 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:06.542397 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:06.542413 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:06.543553 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:06.543559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:06.545292 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:06.545305 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:06.546117 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:06.546125 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:06.546351 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:06.546977 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:06.546999 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:06.549057 (+ 2058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:06.551763 (+ 2706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:06.551771 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:06.551786 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:06.552180 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:06.552519 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:06.552524 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:06.552528 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:06.552716 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:06.553240 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:06.553248 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:06.553556 (+ 308us) client_negotiation.cc:769] Sending connection context
0809 19:01:06.553802 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 19:01:06.554283 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":261,"threads_started":1}
I20260809 19:01:06.556844 12123 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33965
I20260809 19:01:06.557183 12123 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:06.557958 12123 heartbeater.cc:511] Master 127.16.188.254:33965 requested a full tablet report, sending...
I20260809 19:01:06.559988 11812 ts_manager.cc:194] Registered new tserver with Master: 01f32fb49eb24b809dea2905ef60badb (127.16.188.193:38357)
I20260809 19:01:06.561442 11812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:36759
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 19:01:06.606133 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33965
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:06.928386 12130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:06.928646 12130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:06.928771 12130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:06.935674 12130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:06.935775 12130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:06.935921 12130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:01:06.949473 12130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:06.950882 12130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:06.952498 12130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:06.966077 12142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:06.966146 12139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:06.966162 12140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:06.966775 12130 server_base.cc:1034] running on GCE node
I20260809 19:01:06.967347 12130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:06.968186 12130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:06.969369 12130 hybrid_clock.cc:648] HybridClock initialized: now 1786302066969327 us; error 34 us; skew 500 ppm
I20260809 19:01:06.969643 12130 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:06 dist-test-slave-266d krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302066, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:06.972500 12130 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 19:01:06.973819 12130 webserver.cc:460] Webserver started at http://127.16.188.194:41755/ using document root <none> and password file <none>
I20260809 19:01:06.974435 12130 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:06.974550 12130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:06.974828 12130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:06.977584 12130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "1414fc25791b4008b31cd1670a352120"
format_stamp: "Formatted at 2026-08-09 19:01:06 on dist-test-slave-266d"
server_key: "8f6462d19bfa1dbbb3e8ef7900feb8dc"
server_key_iv: "f572b9435c76c6ab36b35b95b330c6dc"
server_key_version: "encryptionkey@0"
I20260809 19:01:06.978278 12130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "1414fc25791b4008b31cd1670a352120"
format_stamp: "Formatted at 2026-08-09 19:01:06 on dist-test-slave-266d"
server_key: "8f6462d19bfa1dbbb3e8ef7900feb8dc"
server_key_iv: "f572b9435c76c6ab36b35b95b330c6dc"
server_key_version: "encryptionkey@0"
I20260809 19:01:06.983222 12130 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:01:06.986563 12157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:06.987797 12130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:01:06.987944 12130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "1414fc25791b4008b31cd1670a352120"
format_stamp: "Formatted at 2026-08-09 19:01:06 on dist-test-slave-266d"
server_key: "8f6462d19bfa1dbbb3e8ef7900feb8dc"
server_key_iv: "f572b9435c76c6ab36b35b95b330c6dc"
server_key_version: "encryptionkey@0"
I20260809 19:01:06.988107 12130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:06.999008 12130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:07.002666 12130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:07.002929 12130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:07.003813 12130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:07.005066 12130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:07.005182 12130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:07.005303 12130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:07.005358 12130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:07.035243 12130 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:41217
I20260809 19:01:07.035291 12358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:41217 every 8 connection(s)
I20260809 19:01:07.036480 12130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:01:07.041476 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 12130
I20260809 19:01:07.041644 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 19:01:07.042079 17139 external_mini_cluster.cc:1428] Setting key a54e48fbb1d0379199c2c5532ad492f6
Aug 09 19:01:07 dist-test-slave-266d krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302066, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:07.056588 12125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.038930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:60691 (local address 127.16.188.254:33965)
0809 19:01:07.039161 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.039168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.040253 (+ 1085us) server_negotiation.cc:407] Connection header received
0809 19:01:07.042074 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.042080 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.042182 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.042298 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:07.043745 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.044551 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.046659 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.047080 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.047184 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.050916 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:07.050920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:07.050924 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:07.050956 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:07.053495 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:07.054195 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:07.054198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:07.054201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:07.054327 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:07.054820 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:07.054824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:07.054827 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:07.055134 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:07.055237 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.056003 (+ 766us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.056238 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:01:07.057894 12361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.039399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33965 (local address 127.16.188.194:60691)
0809 19:01:07.040102 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:07.040138 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:07.041819 (+ 1681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:07.042477 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:07.042485 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:07.043037 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:07.043590 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.043607 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.044707 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.044713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.046508 (+ 1795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.046530 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.047308 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.047315 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.047583 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.048249 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:07.048285 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:07.050707 (+ 2422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:07.053626 (+ 2919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:07.053635 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:07.053652 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:07.054063 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:07.054429 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:07.054434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:07.054438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:07.054683 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:07.055319 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:07.055324 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:07.055634 (+ 310us) client_negotiation.cc:769] Sending connection context
0809 19:01:07.055867 (+ 233us) client_negotiation.cc:240] Negotiation successful
0809 19:01:07.056775 (+ 908us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":277,"threads_started":1}
I20260809 19:01:07.059289 12359 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33965
I20260809 19:01:07.059602 12359 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:07.060310 12359 heartbeater.cc:511] Master 127.16.188.254:33965 requested a full tablet report, sending...
I20260809 19:01:07.061810 11812 ts_manager.cc:194] Registered new tserver with Master: 1414fc25791b4008b31cd1670a352120 (127.16.188.194:41217)
I20260809 19:01:07.062610 11812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:60691
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 19:01:07.104717 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33965
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:07.444238 12367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:07.444517 12367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:07.444640 12367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:07.451820 12367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:07.451931 12367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:07.452097 12367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:01:07.462061 12367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:07.463312 12367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:07.464598 12367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:07.477456 12385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:07.477530 12376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:07.477532 12381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:07.478421 12367 server_base.cc:1034] running on GCE node
I20260809 19:01:07.479007 12367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:07.479947 12367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:07.481171 12367 hybrid_clock.cc:648] HybridClock initialized: now 1786302067481119 us; error 45 us; skew 500 ppm
I20260809 19:01:07.481446 12367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:07 dist-test-slave-266d krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302067, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:07.488692 12367 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 19:01:07.490199 12367 webserver.cc:460] Webserver started at http://127.16.188.195:35373/ using document root <none> and password file <none>
I20260809 19:01:07.490844 12367 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:07.490964 12367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:07.491269 12367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:07.494122 12367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "cf941d3cc8cc47f5945452a9ca0dce1b"
format_stamp: "Formatted at 2026-08-09 19:01:07 on dist-test-slave-266d"
server_key: "5c451519ed06dce291ceff29544066d3"
server_key_iv: "97a9ffa407b36af8a95f9720fe2f4a7c"
server_key_version: "encryptionkey@0"
I20260809 19:01:07.494844 12367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "cf941d3cc8cc47f5945452a9ca0dce1b"
format_stamp: "Formatted at 2026-08-09 19:01:07 on dist-test-slave-266d"
server_key: "5c451519ed06dce291ceff29544066d3"
server_key_iv: "97a9ffa407b36af8a95f9720fe2f4a7c"
server_key_version: "encryptionkey@0"
I20260809 19:01:07.499948 12367 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:01:07.503288 12394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:07.504528 12367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 19:01:07.504662 12367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "cf941d3cc8cc47f5945452a9ca0dce1b"
format_stamp: "Formatted at 2026-08-09 19:01:07 on dist-test-slave-266d"
server_key: "5c451519ed06dce291ceff29544066d3"
server_key_iv: "97a9ffa407b36af8a95f9720fe2f4a7c"
server_key_version: "encryptionkey@0"
I20260809 19:01:07.504814 12367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:07.527101 12367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:07.530786 12367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:07.531018 12367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:07.531886 12367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:07.533133 12367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:07.533202 12367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:07.533300 12367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:07.533349 12367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:07.564670 12123 heartbeater.cc:503] Master 127.16.188.254:33965 was elected leader, sending a full tablet report...
I20260809 19:01:07.566323 12367 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:40711
I20260809 19:01:07.566345 12579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:40711 every 8 connection(s)
I20260809 19:01:07.567612 12367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:01:07.572396 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 12367
I20260809 19:01:07.572557 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 19:01:07.572984 17139 external_mini_cluster.cc:1428] Setting key 766f3f33c72cf6c8bbe4d5037e6a4cf9
Aug 09 19:01:07 dist-test-slave-266d krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302067, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:07.588467 12585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.570165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:45695 (local address 127.16.188.254:33965)
0809 19:01:07.570709 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.570716 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.573146 (+ 2430us) server_negotiation.cc:407] Connection header received
0809 19:01:07.574065 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.574069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.574129 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.574242 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:07.576130 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.576961 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.578598 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.579043 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.579164 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.582626 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:07.582631 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:07.582635 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:07.582670 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:07.585232 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:07.585977 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:07.585981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:07.585983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:07.586125 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:07.586576 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:07.586580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:07.586582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:07.586901 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:07.587064 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.587842 (+ 778us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.588032 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":265,"threads_started":1}
I20260809 19:01:07.589356 12586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.570750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33965 (local address 127.16.188.195:45695)
0809 19:01:07.571678 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:07.571734 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:07.573788 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:07.574494 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:07.574501 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:07.575135 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:07.575955 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.575979 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.577147 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.577151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.578450 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.578464 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.579283 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.579292 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.579555 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.580228 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:07.580252 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:07.582395 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:07.585364 (+ 2969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:07.585373 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:07.585389 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:07.585846 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:07.586237 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:07.586242 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:07.586247 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:07.586443 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:07.587047 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:07.587056 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:07.587413 (+ 357us) client_negotiation.cc:769] Sending connection context
0809 19:01:07.587691 (+ 278us) client_negotiation.cc:240] Negotiation successful
0809 19:01:07.588235 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":382,"threads_started":1}
I20260809 19:01:07.590615 12581 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33965
I20260809 19:01:07.590929 12581 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:07.591737 12581 heartbeater.cc:511] Master 127.16.188.254:33965 requested a full tablet report, sending...
I20260809 19:01:07.593111 11812 ts_manager.cc:194] Registered new tserver with Master: cf941d3cc8cc47f5945452a9ca0dce1b (127.16.188.195:40711)
I20260809 19:01:07.593907 11812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:45695
I20260809 19:01:07.600296 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:01:07.617736 12585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.604608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33770 (local address 127.16.188.254:33965)
0809 19:01:07.604770 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.604775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.605216 (+ 441us) server_negotiation.cc:407] Connection header received
0809 19:01:07.605394 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.605399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.605468 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.605547 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:07.607064 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.607821 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.609472 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.609930 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.610075 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.612581 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:07.612586 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:07.612590 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:07.612626 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:07.614916 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:07.615600 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:07.615606 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:07.615611 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:07.615757 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:07.616142 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:07.616148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:07.616152 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:07.616507 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:07.616766 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.617168 (+ 402us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.617394 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:01:07.621464 11812 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:01:07.628098 11812 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:01:07.649899 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.639341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:38357 (local address 127.0.0.1:46836)
0809 19:01:07.640198 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:07.640240 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:07.640418 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:07.641675 (+ 1257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:07.641684 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:07.641717 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:07.642135 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.642146 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.644422 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.644429 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.646870 (+ 2441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.646887 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.648900 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.648907 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.649145 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.649202 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 19:01:07.649313 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 19:01:07.649504 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":469,"threads_started":1}
I20260809 19:01:07.651664 12601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.639576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46836 (local address 127.16.188.193:38357)
0809 19:01:07.641019 (+ 1443us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.641029 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.641058 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:01:07.641183 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.641191 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.641439 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.642362 (+ 923us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:07.642599 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.644260 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.647097 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.648639 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.650954 (+ 2315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.651132 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.651196 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.651356 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1288,"thread_start_us":1119,"threads_started":1}
I20260809 19:01:07.655807 12014 tablet_service.cc:1467] Processing CreateTablet for tablet 3d8e60c94243415fba60da26a8adaea0 (DEFAULT_TABLE table=test-table [id=03840898470f49ecbd4ad4278b37bc1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:07.657433 12014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d8e60c94243415fba60da26a8adaea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:07.659817 12598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.639496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:40711 (local address 127.0.0.1:54420)
0809 19:01:07.640815 (+ 1319us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:07.640831 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:07.640932 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:07.652113 (+ 11181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:07.652118 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:07.652144 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:07.652505 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.652516 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.655152 (+ 2636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.655157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.657177 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.657192 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.659010 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.659016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.659187 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.659220 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 19:01:07.659323 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 19:01:07.659445 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1207,"thread_start_us":1066,"threads_started":1}
I20260809 19:01:07.659868 12602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.639993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54420 (local address 127.16.188.195:40711)
0809 19:01:07.651349 (+ 11356us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.651357 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.651409 (+ 52us) server_negotiation.cc:407] Connection header received
0809 19:01:07.651500 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.651508 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.651730 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.652696 (+ 966us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:07.653774 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.655024 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.657360 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.658478 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.658678 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.658843 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.659392 (+ 549us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.659553 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11173,"thread_start_us":11869,"threads_started":1}
I20260809 19:01:07.660210 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.640916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:41217 (local address 127.0.0.1:33724)
0809 19:01:07.650135 (+ 9219us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:07.650153 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:07.650254 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:07.653820 (+ 3566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:07.653825 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:07.653852 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:07.654038 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.654048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.656077 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.656082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.657898 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.657912 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.659442 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.659449 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.659644 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.659678 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 19:01:07.659751 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 19:01:07.659905 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9112,"mutex_wait_us":1,"thread_start_us":12422,"threads_started":1}
I20260809 19:01:07.661341 12606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.641492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33724 (local address 127.16.188.194:41217)
0809 19:01:07.653269 (+ 11777us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.653278 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.653304 (+ 26us) server_negotiation.cc:407] Connection header received
0809 19:01:07.653391 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.653397 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.653599 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.654198 (+ 599us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:07.654426 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.655898 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.658060 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.659258 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.660612 (+ 1354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.660772 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.660835 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.660987 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11626,"thread_start_us":11470,"threads_started":1}
I20260809 19:01:07.663950 12470 tablet_service.cc:1467] Processing CreateTablet for tablet 3d8e60c94243415fba60da26a8adaea0 (DEFAULT_TABLE table=test-table [id=03840898470f49ecbd4ad4278b37bc1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:07.664577 12246 tablet_service.cc:1467] Processing CreateTablet for tablet 3d8e60c94243415fba60da26a8adaea0 (DEFAULT_TABLE table=test-table [id=03840898470f49ecbd4ad4278b37bc1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:07.665504 12470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d8e60c94243415fba60da26a8adaea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:07.665871 12246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d8e60c94243415fba60da26a8adaea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:07.672675 12607 tablet_bootstrap.cc:492] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Bootstrap starting.
I20260809 19:01:07.675895 12607 tablet_bootstrap.cc:654] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:07.677034 12607 log.cc:824] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:07.680198 12613 tablet_bootstrap.cc:492] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Bootstrap starting.
I20260809 19:01:07.680526 12611 tablet_bootstrap.cc:492] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Bootstrap starting.
I20260809 19:01:07.681277 12607 tablet_bootstrap.cc:492] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: No bootstrap required, opened a new log
I20260809 19:01:07.681540 12607 ts_tablet_manager.cc:1397] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 19:01:07.683568 12611 tablet_bootstrap.cc:654] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:07.683708 12613 tablet_bootstrap.cc:654] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:07.684612 12611 log.cc:824] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:07.684864 12613 log.cc:824] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:07.687496 12613 tablet_bootstrap.cc:492] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: No bootstrap required, opened a new log
I20260809 19:01:07.687588 12611 tablet_bootstrap.cc:492] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: No bootstrap required, opened a new log
I20260809 19:01:07.687755 12613 ts_tablet_manager.cc:1397] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 19:01:07.687848 12611 ts_tablet_manager.cc:1397] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 19:01:07.691390 12607 raft_consensus.cc:348] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.691882 12607 raft_consensus.cc:374] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:07.692024 12607 raft_consensus.cc:729] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01f32fb49eb24b809dea2905ef60badb, State: Initialized, Role: FOLLOWER
I20260809 19:01:07.692637 12607 consensus_queue.cc:260] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.694362 12607 ts_tablet_manager.cc:1428] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260809 19:01:07.696004 12613 raft_consensus.cc:348] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.696321 12613 raft_consensus.cc:374] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:07.696419 12613 raft_consensus.cc:729] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf941d3cc8cc47f5945452a9ca0dce1b, State: Initialized, Role: FOLLOWER
I20260809 19:01:07.696943 12613 consensus_queue.cc:260] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.697415 12611 raft_consensus.cc:348] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.698104 12581 heartbeater.cc:503] Master 127.16.188.254:33965 was elected leader, sending a full tablet report...
I20260809 19:01:07.698427 12611 raft_consensus.cc:374] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:07.698594 12613 ts_tablet_manager.cc:1428] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
I20260809 19:01:07.698583 12611 raft_consensus.cc:729] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1414fc25791b4008b31cd1670a352120, State: Initialized, Role: FOLLOWER
I20260809 19:01:07.699133 12611 consensus_queue.cc:260] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.700186 12359 heartbeater.cc:503] Master 127.16.188.254:33965 was elected leader, sending a full tablet report...
I20260809 19:01:07.700625 12611 ts_tablet_manager.cc:1428] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
W20260809 19:01:07.787716 12124 tablet.cc:2369] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:01:07.788364 12360 tablet.cc:2369] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:01:07.819159 12584 tablet.cc:2369] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:07.867399 12616 raft_consensus.cc:482] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:01:07.867837 12616 raft_consensus.cc:504] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.869648 12616 leader_election.cc:288] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf941d3cc8cc47f5945452a9ca0dce1b (127.16.188.195:40711), 1414fc25791b4008b31cd1670a352120 (127.16.188.194:41217)
I20260809 19:01:07.876243 12602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.870607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:39817 (local address 127.16.188.195:40711)
0809 19:01:07.870826 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.870832 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.870857 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:01:07.871089 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.871097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.871160 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.871211 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:07.871828 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.872773 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.874595 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.875360 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.875509 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.875588 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.875871 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.875994 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:01:07.876291 12606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.870966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:44841 (local address 127.16.188.194:41217)
0809 19:01:07.871182 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.871189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.871472 (+ 283us) server_negotiation.cc:407] Connection header received
0809 19:01:07.871667 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.871672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.871732 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.871811 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:07.872282 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.872975 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.874684 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.875444 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.875581 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.875653 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.875933 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.876054 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:01:07.876330 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.870043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:40711 (local address 127.16.188.193:39817)
0809 19:01:07.870709 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:07.870728 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:07.870901 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:07.871393 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:07.871397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:07.871419 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:07.871695 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.871703 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.872901 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.872907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.874439 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.874452 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.875561 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.875567 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.875721 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.875749 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 19:01:07.875829 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 19:01:07.875954 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":323,"threads_started":1}
I20260809 19:01:07.876441 12621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.870824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:41217 (local address 127.16.188.193:44841)
0809 19:01:07.871374 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:07.871392 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:07.871540 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:07.871843 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:07.871846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:07.871865 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:07.872144 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.872151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.873135 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.873139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.874540 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:07.874553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.875658 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.875665 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:07.875794 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.875816 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 19:01:07.875893 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 19:01:07.876008 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":16,"thread_start_us":364,"threads_started":1}
I20260809 19:01:07.877453 12283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d8e60c94243415fba60da26a8adaea0" candidate_uuid: "01f32fb49eb24b809dea2905ef60badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1414fc25791b4008b31cd1670a352120" is_pre_election: true
I20260809 19:01:07.877588 12509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d8e60c94243415fba60da26a8adaea0" candidate_uuid: "01f32fb49eb24b809dea2905ef60badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" is_pre_election: true
I20260809 19:01:07.877974 12283 raft_consensus.cc:2454] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01f32fb49eb24b809dea2905ef60badb in term 0.
I20260809 19:01:07.878038 12509 raft_consensus.cc:2454] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01f32fb49eb24b809dea2905ef60badb in term 0.
I20260809 19:01:07.878634 11946 leader_election.cc:302] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01f32fb49eb24b809dea2905ef60badb, 1414fc25791b4008b31cd1670a352120; no voters:
I20260809 19:01:07.879000 12616 raft_consensus.cc:2781] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:01:07.879173 12616 raft_consensus.cc:482] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:01:07.879302 12616 raft_consensus.cc:3037] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:07.881574 12616 raft_consensus.cc:504] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.882124 12616 leader_election.cc:288] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [CANDIDATE]: Term 1 election: Requested vote from peers cf941d3cc8cc47f5945452a9ca0dce1b (127.16.188.195:40711), 1414fc25791b4008b31cd1670a352120 (127.16.188.194:41217)
I20260809 19:01:07.882545 12509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d8e60c94243415fba60da26a8adaea0" candidate_uuid: "01f32fb49eb24b809dea2905ef60badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b"
I20260809 19:01:07.882580 12283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d8e60c94243415fba60da26a8adaea0" candidate_uuid: "01f32fb49eb24b809dea2905ef60badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1414fc25791b4008b31cd1670a352120"
I20260809 19:01:07.882757 12283 raft_consensus.cc:3037] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:07.882750 12509 raft_consensus.cc:3037] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:07.884974 12283 raft_consensus.cc:2454] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01f32fb49eb24b809dea2905ef60badb in term 1.
I20260809 19:01:07.884981 12509 raft_consensus.cc:2454] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01f32fb49eb24b809dea2905ef60badb in term 1.
I20260809 19:01:07.885375 11946 leader_election.cc:302] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01f32fb49eb24b809dea2905ef60badb, 1414fc25791b4008b31cd1670a352120; no voters:
I20260809 19:01:07.885695 12616 raft_consensus.cc:2781] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:07.886134 12616 raft_consensus.cc:686] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 1 LEADER]: Becoming Leader. State: Replica: 01f32fb49eb24b809dea2905ef60badb, State: Running, Role: LEADER
I20260809 19:01:07.886729 12616 consensus_queue.cc:237] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } }
I20260809 19:01:07.891697 11812 catalog_manager.cc:5495] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb reported cstate change: term changed from 0 to 1, leader changed from <none> to 01f32fb49eb24b809dea2905ef60badb (127.16.188.193). New cstate: current_term: 1 leader_uuid: "01f32fb49eb24b809dea2905ef60badb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f32fb49eb24b809dea2905ef60badb" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 38357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 } health_report { overall_health: UNKNOWN } } }
I20260809 19:01:07.956378 12601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:07.951589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46842 (local address 127.16.188.193:38357)
0809 19:01:07.951782 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:07.951786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:07.951805 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:01:07.951965 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:07.951969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:07.952050 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:07.952172 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:07.952487 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.953215 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.954510 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:07.954915 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:07.955000 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:07.955389 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:07.955903 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:07.956010 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:07.956049 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 19:01:07.956114 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:01:07.964603 12509 raft_consensus.cc:1261] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 1 FOLLOWER]: Refusing update from remote peer 01f32fb49eb24b809dea2905ef60badb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:07.964604 12283 raft_consensus.cc:1261] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 1 FOLLOWER]: Refusing update from remote peer 01f32fb49eb24b809dea2905ef60badb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:07.965574 12616 consensus_queue.cc:1035] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf941d3cc8cc47f5945452a9ca0dce1b" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 40711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:07.965868 12626 consensus_queue.cc:1035] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1414fc25791b4008b31cd1670a352120" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:07.977174 12634 mvcc.cc:205] Tried to move back new op lower bound from 7316693270372700160 to 7316693270068776960. Current Snapshot: MvccSnapshot[applied={T|T < 7316693270372700160}]
I20260809 19:01:07.977240 12636 mvcc.cc:205] Tried to move back new op lower bound from 7316693270372700160 to 7316693270068776960. Current Snapshot: MvccSnapshot[applied={T|T < 7316693270372700160}]
I20260809 19:01:07.979565 12637 mvcc.cc:205] Tried to move back new op lower bound from 7316693270372700160 to 7316693270068776960. Current Snapshot: MvccSnapshot[applied={T|T < 7316693270372700160}]
I20260809 19:01:07.990926 11812 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:07.991163 11812 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:07.994643 11812 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f5cbaa01d113460f8aad7b781ce105e4: Sending DeleteTablet for 3 replicas of tablet 3d8e60c94243415fba60da26a8adaea0
I20260809 19:01:07.995697 12014 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d8e60c94243415fba60da26a8adaea0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:07 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:46836
I20260809 19:01:07.995837 12470 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d8e60c94243415fba60da26a8adaea0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:07 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:54420
I20260809 19:01:07.996049 12246 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d8e60c94243415fba60da26a8adaea0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:07 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:33724
I20260809 19:01:07.998948 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 11918
I20260809 19:01:08.006922 12650 tablet_replica.cc:330] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: stopping tablet replica
I20260809 19:01:08.007413 12650 raft_consensus.cc:2229] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:01:08.008097 12650 raft_consensus.cc:2258] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:08.010418 12650 ts_tablet_manager.cc:1905] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:08.013818 12654 tablet_replica.cc:330] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: stopping tablet replica
I20260809 19:01:08.014439 12654 raft_consensus.cc:2229] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:08.015081 12654 raft_consensus.cc:2258] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:08.017470 12654 ts_tablet_manager.cc:1905] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:08.017941 12650 ts_tablet_manager.cc:1918] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:08.017989 12652 tablet_replica.cc:330] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: stopping tablet replica
I20260809 19:01:08.018102 12650 log.cc:1196] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/3d8e60c94243415fba60da26a8adaea0
I20260809 19:01:08.018345 12652 raft_consensus.cc:2229] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:08.018658 12650 ts_tablet_manager.cc:1939] T 3d8e60c94243415fba60da26a8adaea0 P 01f32fb49eb24b809dea2905ef60badb: Deleting consensus metadata
I20260809 19:01:08.018791 12652 raft_consensus.cc:2258] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:08.020823 12652 ts_tablet_manager.cc:1905] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:08.020787 11791 catalog_manager.cc:4841] TS 01f32fb49eb24b809dea2905ef60badb (127.16.188.193:38357): tablet 3d8e60c94243415fba60da26a8adaea0 (table test-table [id=03840898470f49ecbd4ad4278b37bc1e]) successfully deleted
Aug 09 19:01:08 dist-test-slave-266d krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 19:01:08.025636 12654 ts_tablet_manager.cc:1918] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:08.025799 12654 log.cc:1196] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/3d8e60c94243415fba60da26a8adaea0
I20260809 19:01:08.026317 12654 ts_tablet_manager.cc:1939] T 3d8e60c94243415fba60da26a8adaea0 P 1414fc25791b4008b31cd1670a352120: Deleting consensus metadata
I20260809 19:01:08.027401 12652 ts_tablet_manager.cc:1918] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:08.027554 12652 log.cc:1196] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/3d8e60c94243415fba60da26a8adaea0
I20260809 19:01:08.028067 12652 ts_tablet_manager.cc:1939] T 3d8e60c94243415fba60da26a8adaea0 P cf941d3cc8cc47f5945452a9ca0dce1b: Deleting consensus metadata
I20260809 19:01:08.028144 11790 catalog_manager.cc:4841] TS 1414fc25791b4008b31cd1670a352120 (127.16.188.194:41217): tablet 3d8e60c94243415fba60da26a8adaea0 (table test-table [id=03840898470f49ecbd4ad4278b37bc1e]) successfully deleted
I20260809 19:01:08.029767 12601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:08.000303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46848 (local address 127.16.188.193:38357)
0809 19:01:08.000488 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:08.000495 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:08.013056 (+ 12561us) server_negotiation.cc:407] Connection header received
0809 19:01:08.013565 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:08.013570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:08.013669 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:08.013737 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:08.015542 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:08.016701 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:08.018567 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:08.019217 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:08.019312 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:08.023818 (+ 4506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:08.023830 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:08.023843 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:08.023874 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:08.026706 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:08.027335 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:08.027342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:08.027344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:08.027479 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:08.027904 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:08.027908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:08.027911 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:08.028425 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:08.028661 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:08.029174 (+ 513us) server_negotiation.cc:299] Negotiation successful
0809 19:01:08.029416 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:01:08.029737 11790 catalog_manager.cc:4841] TS cf941d3cc8cc47f5945452a9ca0dce1b (127.16.188.195:40711): tablet 3d8e60c94243415fba60da26a8adaea0 (table test-table [id=03840898470f49ecbd4ad4278b37bc1e]) successfully deleted
I20260809 19:01:08.030439 12116 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:08.123179 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 11918
I20260809 19:01:08.144062 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 12130
Aug 09 19:01:08 dist-test-slave-266d krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 19:01:08.157912 12606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:08.144869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33732 (local address 127.16.188.194:41217)
0809 19:01:08.145044 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:08.145048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:08.145067 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:01:08.145197 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:08.145201 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:08.145275 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:08.145356 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:08.146527 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:08.147287 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:08.148468 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:08.148850 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:08.148936 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:08.152863 (+ 3927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:08.152876 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:08.152889 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:08.152921 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:08.155548 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:08.156131 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:08.156137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:08.156139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:08.156252 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:08.156608 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:08.156611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:08.156613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:08.156949 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:08.157216 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:08.157423 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 19:01:08.157575 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:01:08.158631 12353 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:08.245781 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 12130
I20260809 19:01:08.265388 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 12367
Aug 09 19:01:08 dist-test-slave-266d krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 19:01:08.281306 12602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:08.266218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54422 (local address 127.16.188.195:40711)
0809 19:01:08.266416 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:08.266422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:08.266445 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:01:08.266625 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:08.266630 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:08.266703 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:08.266797 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:08.268251 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:08.269011 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:08.270399 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:08.270816 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:08.270943 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:08.275519 (+ 4576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:08.275536 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:08.275564 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:08.275611 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:08.278278 (+ 2667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:08.278961 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:08.278972 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:08.278975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:08.279159 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:08.279582 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:08.279585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:08.279588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:08.279966 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:08.280262 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:08.280649 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 19:01:08.280868 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 19:01:08.281989 12570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:08.370076 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 12367
I20260809 19:01:08.391495 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 11753
I20260809 19:01:08.392613 11870 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:08.499194 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 11753
2026-08-09T19:01:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4558 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T19:01:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:08Z Disabled control of system clock
I20260809 19:01:08.589176 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:33593
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:39299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:33593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:01:08.917235 12669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:08.917520 12669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:08.917609 12669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:08.924726 12669 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:08.924822 12669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:08.924866 12669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:08.924923 12669 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:08.924965 12669 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:08.933938 12669 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:33593
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:33593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:08.935128 12669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:08.936869 12669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:08.948167 12680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:08.948230 12684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:08.948216 12682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:08.949113 12669 server_base.cc:1034] running on GCE node
I20260809 19:01:08.949855 12669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:08.951169 12669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:08.952368 12669 hybrid_clock.cc:648] HybridClock initialized: now 1786302068952316 us; error 44 us; skew 500 ppm
I20260809 19:01:08.952673 12669 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:08.954795 12669 webserver.cc:460] Webserver started at http://127.16.188.254:34633/ using document root <none> and password file <none>
I20260809 19:01:08.955423 12669 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:08.955523 12669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:08.955839 12669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:08.958606 12669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "85176c7af3544b8fa0af91e46c3782c1"
format_stamp: "Formatted at 2026-08-09 19:01:08 on dist-test-slave-266d"
server_key: "d8a108dfffaf1dfcd861fc1c008be770"
server_key_iv: "959023e8edddef9d6ad90eec330256b0"
server_key_version: "encryptionkey@0"
I20260809 19:01:08.959374 12669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "85176c7af3544b8fa0af91e46c3782c1"
format_stamp: "Formatted at 2026-08-09 19:01:08 on dist-test-slave-266d"
server_key: "d8a108dfffaf1dfcd861fc1c008be770"
server_key_iv: "959023e8edddef9d6ad90eec330256b0"
server_key_version: "encryptionkey@0"
I20260809 19:01:08.964160 12669 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:01:08.967463 12693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:08.968674 12669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:01:08.968847 12669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "85176c7af3544b8fa0af91e46c3782c1"
format_stamp: "Formatted at 2026-08-09 19:01:08 on dist-test-slave-266d"
server_key: "d8a108dfffaf1dfcd861fc1c008be770"
server_key_iv: "959023e8edddef9d6ad90eec330256b0"
server_key_version: "encryptionkey@0"
I20260809 19:01:08.969038 12669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:08.982260 12669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:08.982983 12669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:08.983232 12669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:09.000034 12669 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:33593
I20260809 19:01:09.000042 12768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:33593 every 8 connection(s)
I20260809 19:01:09.001390 12669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:09.005302 12770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:09.011068 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 12669
I20260809 19:01:09.011234 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:09.011651 17139 external_mini_cluster.cc:1428] Setting key f28b22f5d58537d6f24bd6362aa1cd5a
I20260809 19:01:09.016605 12770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1: Bootstrap starting.
I20260809 19:01:09.019793 12770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:09.020848 12770 log.cc:824] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:09.023715 12770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1: No bootstrap required, opened a new log
I20260809 19:01:09.024403 12776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:09.013555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42986 (local address 127.16.188.254:33593)
0809 19:01:09.014556 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:09.014566 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:09.014612 (+ 46us) server_negotiation.cc:407] Connection header received
0809 19:01:09.016227 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:09.016249 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:09.016668 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:09.017031 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:09.017573 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:09.018867 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:09.020240 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:09.020877 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:09.021041 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:09.022216 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:09.022224 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:09.022237 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:09.022735 (+ 498us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:09.022817 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:09.022837 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:09.022936 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:09.023160 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 19:01:09.023429 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":378,"threads_started":1}
I20260809 19:01:09.031505 12770 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85176c7af3544b8fa0af91e46c3782c1" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33593 } }
I20260809 19:01:09.031863 12770 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:09.031972 12770 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85176c7af3544b8fa0af91e46c3782c1, State: Initialized, Role: FOLLOWER
I20260809 19:01:09.032547 12770 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85176c7af3544b8fa0af91e46c3782c1" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33593 } }
I20260809 19:01:09.032879 12770 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:09.033043 12770 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:09.033280 12770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:09.036006 12770 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85176c7af3544b8fa0af91e46c3782c1" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33593 } }
I20260809 19:01:09.036482 12770 leader_election.cc:302] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85176c7af3544b8fa0af91e46c3782c1; no voters:
I20260809 19:01:09.037078 12770 leader_election.cc:288] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:09.037220 12779 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:09.038120 12779 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [term 1 LEADER]: Becoming Leader. State: Replica: 85176c7af3544b8fa0af91e46c3782c1, State: Running, Role: LEADER
I20260809 19:01:09.038578 12779 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85176c7af3544b8fa0af91e46c3782c1" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33593 } }
I20260809 19:01:09.039175 12770 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:09.041323 12780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85176c7af3544b8fa0af91e46c3782c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85176c7af3544b8fa0af91e46c3782c1" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33593 } } }
I20260809 19:01:09.041766 12780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:09.043263 12781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85176c7af3544b8fa0af91e46c3782c1. Latest consensus state: current_term: 1 leader_uuid: "85176c7af3544b8fa0af91e46c3782c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85176c7af3544b8fa0af91e46c3782c1" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 33593 } } }
I20260809 19:01:09.043596 12781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:09.049731 12785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:09.053769 12785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:09.061143 12785 catalog_manager.cc:1347] Generated new cluster ID: be50f39f618a4618b1ae53f1880d8554
I20260809 19:01:09.061262 12785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:09.095963 12785 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:09.097362 12785 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:09.113943 12785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1: Generated new TSK 0
I20260809 19:01:09.114778 12785 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:09.126076 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33593
--builtin_ntp_servers=127.16.188.212:39299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:01:09.458211 12804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:09.458462 12804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:09.458583 12804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:09.465760 12804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:09.465852 12804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:09.466001 12804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:01:09.475185 12804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:09.476383 12804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:09.478189 12804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:09.490446 12822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:09.490419 12823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:09.490451 12827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:09.491432 12804 server_base.cc:1034] running on GCE node
I20260809 19:01:09.491987 12804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:09.492897 12804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:09.494148 12804 hybrid_clock.cc:648] HybridClock initialized: now 1786302069494073 us; error 41 us; skew 500 ppm
I20260809 19:01:09.494469 12804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:09.496598 12804 webserver.cc:460] Webserver started at http://127.16.188.193:46285/ using document root <none> and password file <none>
I20260809 19:01:09.497299 12804 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:09.497404 12804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:09.497706 12804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:09.500490 12804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "3834dca3e9754ea389e8a424973905e7"
format_stamp: "Formatted at 2026-08-09 19:01:09 on dist-test-slave-266d"
server_key: "d99be7a845180ce22bcdbcf812864ccb"
server_key_iv: "24334a516fc0517f3ca12dd998109dfa"
server_key_version: "encryptionkey@0"
I20260809 19:01:09.501323 12804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "3834dca3e9754ea389e8a424973905e7"
format_stamp: "Formatted at 2026-08-09 19:01:09 on dist-test-slave-266d"
server_key: "d99be7a845180ce22bcdbcf812864ccb"
server_key_iv: "24334a516fc0517f3ca12dd998109dfa"
server_key_version: "encryptionkey@0"
I20260809 19:01:09.506243 12804 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 19:01:09.509436 12834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:09.510671 12804 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 19:01:09.510844 12804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "3834dca3e9754ea389e8a424973905e7"
format_stamp: "Formatted at 2026-08-09 19:01:09 on dist-test-slave-266d"
server_key: "d99be7a845180ce22bcdbcf812864ccb"
server_key_iv: "24334a516fc0517f3ca12dd998109dfa"
server_key_version: "encryptionkey@0"
I20260809 19:01:09.511050 12804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:09.534118 12804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:09.534904 12804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:09.535233 12804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:09.536190 12804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:09.537788 12804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:09.537899 12804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:09.538010 12804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:09.538096 12804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:09.569741 12804 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:43379
I20260809 19:01:09.569800 13018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:43379 every 8 connection(s)
I20260809 19:01:09.571053 12804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:01:09.574962 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 12804
I20260809 19:01:09.575140 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 19:01:09.575631 17139 external_mini_cluster.cc:1428] Setting key f3b1cd826f3226c801e796d238ac66e1
I20260809 19:01:09.579697 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33593
--builtin_ntp_servers=127.16.188.212:39299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:01:09.584272 13024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:09.573518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:36231 (local address 127.16.188.254:33593)
0809 19:01:09.573977 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:09.573982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:09.575047 (+ 1065us) server_negotiation.cc:407] Connection header received
0809 19:01:09.577569 (+ 2522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:09.577575 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:09.577660 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:09.577774 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:09.579006 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:09.579820 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:09.581522 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:09.582077 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:09.582191 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:09.583514 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:09.583520 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:09.583524 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:09.583543 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:09.583591 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:09.583606 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:09.583688 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:09.583872 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 19:01:09.583965 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":235,"threads_started":1}
I20260809 19:01:09.585247 13025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:09.574000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33593 (local address 127.16.188.193:36231)
0809 19:01:09.574874 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:09.574923 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:09.577230 (+ 2307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:09.577964 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:09.577972 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:09.578082 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:09.578824 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:09.578845 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:09.580028 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:09.580032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:09.581361 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:09.581375 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:09.582304 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:09.582313 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:09.582576 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:09.583214 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:09.583216 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:09.583254 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:09.583337 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:09.583692 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:09.583698 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:09.583704 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 19:01:09.583848 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 19:01:09.584138 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":262,"threads_started":1}
I20260809 19:01:09.586728 13020 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33593
I20260809 19:01:09.587041 13020 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:09.587865 13020 heartbeater.cc:511] Master 127.16.188.254:33593 requested a full tablet report, sending...
I20260809 19:01:09.590099 12713 ts_manager.cc:194] Registered new tserver with Master: 3834dca3e9754ea389e8a424973905e7 (127.16.188.193:43379)
I20260809 19:01:09.591938 12713 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.193:36231
W20260809 19:01:09.909142 13027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:09.909399 13027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:09.909530 13027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:09.916572 13027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:09.916658 13027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:09.916795 13027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:01:09.925405 13027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:09.926522 13027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:09.928234 13027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:09.940521 13042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:09.940587 13040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:09.940856 13038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:09.941200 13027 server_base.cc:1034] running on GCE node
I20260809 19:01:09.941783 13027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:09.942612 13027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:09.943810 13027 hybrid_clock.cc:648] HybridClock initialized: now 1786302069943772 us; error 28 us; skew 500 ppm
I20260809 19:01:09.944092 13027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:09.946341 13027 webserver.cc:460] Webserver started at http://127.16.188.194:43503/ using document root <none> and password file <none>
I20260809 19:01:09.946982 13027 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:09.947067 13027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:09.947320 13027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:09.950034 13027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "a71c8106445b433e87101feda91cdc9b"
format_stamp: "Formatted at 2026-08-09 19:01:09 on dist-test-slave-266d"
server_key: "e90b9353ec215e1044cfdc37e4f4f839"
server_key_iv: "7f4d125e631e6cc1beba86abf145feb9"
server_key_version: "encryptionkey@0"
I20260809 19:01:09.950743 13027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "a71c8106445b433e87101feda91cdc9b"
format_stamp: "Formatted at 2026-08-09 19:01:09 on dist-test-slave-266d"
server_key: "e90b9353ec215e1044cfdc37e4f4f839"
server_key_iv: "7f4d125e631e6cc1beba86abf145feb9"
server_key_version: "encryptionkey@0"
I20260809 19:01:09.955374 13027 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:01:09.958530 13054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:09.959714 13027 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:01:09.959858 13027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "a71c8106445b433e87101feda91cdc9b"
format_stamp: "Formatted at 2026-08-09 19:01:09 on dist-test-slave-266d"
server_key: "e90b9353ec215e1044cfdc37e4f4f839"
server_key_iv: "7f4d125e631e6cc1beba86abf145feb9"
server_key_version: "encryptionkey@0"
I20260809 19:01:09.960035 13027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:09.979172 13027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:09.979910 13027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:09.980176 13027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:09.981053 13027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:09.982452 13027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:09.982538 13027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:09.982651 13027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:09.982726 13027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:10.013021 13027 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:33365
I20260809 19:01:10.013144 13226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:33365 every 8 connection(s)
I20260809 19:01:10.014348 13027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:01:10.017204 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 13027
I20260809 19:01:10.017397 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 19:01:10.017956 17139 external_mini_cluster.cc:1428] Setting key c321b979c60b743a6ee5f61dceded213
I20260809 19:01:10.021225 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33593
--builtin_ntp_servers=127.16.188.212:39299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:01:10.028365 13024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.017545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:55887 (local address 127.16.188.254:33593)
0809 19:01:10.017733 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.017739 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.019554 (+ 1815us) server_negotiation.cc:407] Connection header received
0809 19:01:10.021819 (+ 2265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.021823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.021889 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.021970 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.023242 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.023931 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.025899 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.026284 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.026379 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.027745 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.027749 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.027752 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:10.027768 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.027799 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:10.027811 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.027876 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.028078 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.028149 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:01:10.029611 13232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.017712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33593 (local address 127.16.188.194:55887)
0809 19:01:10.019408 (+ 1696us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.019454 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.021547 (+ 2093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.022204 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.022215 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.022324 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.023076 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.023100 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.024065 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.024071 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.025756 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.025780 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.026487 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.026493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.026740 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.027442 (+ 702us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:10.027445 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.027492 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:10.027581 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.027893 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.027903 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.027910 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.028061 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.028403 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1243,"thread_start_us":1017,"threads_started":1}
I20260809 19:01:10.030858 13229 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33593
I20260809 19:01:10.031152 13229 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:10.031977 13229 heartbeater.cc:511] Master 127.16.188.254:33593 requested a full tablet report, sending...
I20260809 19:01:10.033353 12713 ts_manager.cc:194] Registered new tserver with Master: a71c8106445b433e87101feda91cdc9b (127.16.188.194:33365)
I20260809 19:01:10.034267 12713 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.194:55887
W20260809 19:01:10.346866 13233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:10.347108 13233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:10.347199 13233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:10.354046 13233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:10.354135 13233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:10.354238 13233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:01:10.362836 13233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:33593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:10.364074 13233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:10.365829 13233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:10.377954 13240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:10.377941 13243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:10.378141 13245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:10.379077 13233 server_base.cc:1034] running on GCE node
I20260809 19:01:10.379634 13233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:10.380518 13233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:10.381711 13233 hybrid_clock.cc:648] HybridClock initialized: now 1786302070381665 us; error 39 us; skew 500 ppm
I20260809 19:01:10.381994 13233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:10.384073 13233 webserver.cc:460] Webserver started at http://127.16.188.195:46387/ using document root <none> and password file <none>
I20260809 19:01:10.384693 13233 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:10.384788 13233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:10.385080 13233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:10.387796 13233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-266d"
server_key: "ec418ac127f9dba0dbdfbad7d85d9354"
server_key_iv: "d6723676a293f9d5a485313011a99f9a"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.388532 13233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-266d"
server_key: "ec418ac127f9dba0dbdfbad7d85d9354"
server_key_iv: "d6723676a293f9d5a485313011a99f9a"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.393283 13233 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:01:10.396396 13254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:10.397591 13233 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:01:10.397742 13233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a"
format_stamp: "Formatted at 2026-08-09 19:01:10 on dist-test-slave-266d"
server_key: "ec418ac127f9dba0dbdfbad7d85d9354"
server_key_iv: "d6723676a293f9d5a485313011a99f9a"
server_key_version: "encryptionkey@0"
I20260809 19:01:10.397929 13233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:10.415618 13233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:10.416322 13233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:10.416602 13233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:10.417496 13233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:10.418883 13233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:10.418985 13233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:10.419088 13233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:10.419162 13233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:10.450186 13233 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:35755
I20260809 19:01:10.450230 13441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:35755 every 8 connection(s)
I20260809 19:01:10.451524 13233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:01:10.459201 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 13233
I20260809 19:01:10.459395 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 19:01:10.459982 17139 external_mini_cluster.cc:1428] Setting key c66ba0eb0dd3f18af1f590fdf277b97e
I20260809 19:01:10.464040 13024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.453931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:41781 (local address 127.16.188.254:33593)
0809 19:01:10.454092 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.454097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.455448 (+ 1351us) server_negotiation.cc:407] Connection header received
0809 19:01:10.457166 (+ 1718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.457173 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.457253 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.457351 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.458337 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.459107 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.461164 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.461726 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.461864 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.463337 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.463342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.463346 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:10.463366 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.463402 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:10.463416 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.463490 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.463668 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.463750 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 19:01:10.464941 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.454423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:33593 (local address 127.16.188.195:41781)
0809 19:01:10.455273 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.455308 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.456868 (+ 1560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.457527 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.457535 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.457613 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:10.458174 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.458191 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.459255 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.459274 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.461008 (+ 1734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.461020 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.462108 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.462112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.462309 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.462996 (+ 687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:10.462999 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:10.463055 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:10.463145 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:10.463489 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:10.463494 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:10.463498 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.463645 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.463954 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":263,"threads_started":1}
I20260809 19:01:10.466248 13442 heartbeater.cc:347] Connected to a master server at 127.16.188.254:33593
I20260809 19:01:10.466497 13442 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:10.467172 13442 heartbeater.cc:511] Master 127.16.188.254:33593 requested a full tablet report, sending...
I20260809 19:01:10.468446 12713 ts_manager.cc:194] Registered new tserver with Master: 90013bfb3b0c47e4bbfa7c9b6780bd5a (127.16.188.195:35755)
I20260809 19:01:10.469221 12713 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.195:41781
I20260809 19:01:10.474900 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:01:10.483965 13024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.478823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55848 (local address 127.16.188.254:33593)
0809 19:01:10.478968 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.478972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.479392 (+ 420us) server_negotiation.cc:407] Connection header received
0809 19:01:10.479542 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.479545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.479617 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.479689 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.480077 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.480734 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.482010 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.482416 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.482506 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.483419 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.483424 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.483427 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:10.483442 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.483472 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:10.483484 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.483547 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.483641 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.483732 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 19:01:10.487290 12713 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:01:10.493948 12713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:01:10.529745 13469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.506221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46580 (local address 127.16.188.194:33365)
0809 19:01:10.521528 (+ 15307us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.521536 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.521559 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:01:10.521637 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.521643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.521809 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.521996 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:10.523388 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.524787 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.527136 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.528450 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.528642 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.528873 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.529199 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.529363 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15144,"thread_start_us":15030,"threads_started":1}
I20260809 19:01:10.529965 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.505906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:43379 (local address 127.0.0.1:53744)
0809 19:01:10.523115 (+ 17209us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.523132 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.523252 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.523783 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.523788 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.523810 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:10.524120 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.524130 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.525796 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.525801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.527674 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.527685 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.529167 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.529174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.529363 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.529399 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.529494 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.529625 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17067,"mutex_wait_us":550,"thread_start_us":14488,"threads_started":1}
I20260809 19:01:10.530157 13464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.505518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53744 (local address 127.16.188.193:43379)
0809 19:01:10.522634 (+ 17116us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.522643 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.523363 (+ 720us) server_negotiation.cc:407] Connection header received
0809 19:01:10.523443 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.523448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.523606 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.523783 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:10.524264 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.525621 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.527831 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.528815 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.528970 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.529190 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.529553 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.529731 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16957,"thread_start_us":16838,"threads_started":1}
I20260809 19:01:10.530467 13466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.505515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:33365 (local address 127.0.0.1:46580)
0809 19:01:10.520792 (+ 15277us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.520832 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.521048 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.522747 (+ 1699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.522750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.522780 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:10.523204 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.523217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.524908 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.524916 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.526954 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.526967 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.528640 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.528646 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.528825 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.528883 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.528994 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.530029 (+ 1035us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14997,"mutex_wait_us":4,"thread_start_us":17291,"threads_started":1}
I20260809 19:01:10.530884 13470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.505898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:35755 (local address 127.0.0.1:36540)
0809 19:01:10.521168 (+ 15270us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.521185 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.521313 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.522053 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.522061 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.522089 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:10.522525 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.522540 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.524678 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.524683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.527137 (+ 2454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.527152 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.529315 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.529321 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.530333 (+ 1012us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.530368 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.530450 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.530571 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15136,"mutex_wait_us":29,"thread_start_us":14432,"threads_started":1}
I20260809 19:01:10.531605 13465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.505542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36540 (local address 127.16.188.195:35755)
0809 19:01:10.520200 (+ 14658us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.520210 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.521439 (+ 1229us) server_negotiation.cc:407] Connection header received
0809 19:01:10.521539 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.521547 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.521805 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.522627 (+ 822us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:10.522928 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.524539 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.527351 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.528656 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.528834 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.529011 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.531104 (+ 2093us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.531261 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14470,"thread_start_us":14303,"threads_started":1}
I20260809 19:01:10.534467 13120 tablet_service.cc:1467] Processing CreateTablet for tablet a59aec7440f445edbb0ea7fde8e2b651 (DEFAULT_TABLE table=test-table [id=f3ecfa63c41345f4b4f5d8c60f24e1ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:10.534497 12915 tablet_service.cc:1467] Processing CreateTablet for tablet a59aec7440f445edbb0ea7fde8e2b651 (DEFAULT_TABLE table=test-table [id=f3ecfa63c41345f4b4f5d8c60f24e1ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:10.535645 13120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a59aec7440f445edbb0ea7fde8e2b651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:10.535142 13333 tablet_service.cc:1467] Processing CreateTablet for tablet a59aec7440f445edbb0ea7fde8e2b651 (DEFAULT_TABLE table=test-table [id=f3ecfa63c41345f4b4f5d8c60f24e1ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:10.535933 12915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a59aec7440f445edbb0ea7fde8e2b651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:10.536829 13333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a59aec7440f445edbb0ea7fde8e2b651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:10.549772 13472 tablet_bootstrap.cc:492] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: Bootstrap starting.
I20260809 19:01:10.551555 13473 tablet_bootstrap.cc:492] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: Bootstrap starting.
I20260809 19:01:10.553313 13472 tablet_bootstrap.cc:654] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:10.554839 13472 log.cc:824] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:10.554953 13473 tablet_bootstrap.cc:654] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:10.556159 13473 log.cc:824] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:10.558139 13472 tablet_bootstrap.cc:492] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: No bootstrap required, opened a new log
I20260809 19:01:10.558369 13476 tablet_bootstrap.cc:492] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Bootstrap starting.
I20260809 19:01:10.558437 13472 ts_tablet_manager.cc:1397] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260809 19:01:10.560827 13476 tablet_bootstrap.cc:654] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:10.561959 13476 log.cc:824] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:10.563470 13473 tablet_bootstrap.cc:492] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: No bootstrap required, opened a new log
I20260809 19:01:10.563720 13473 ts_tablet_manager.cc:1397] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260809 19:01:10.567056 13476 tablet_bootstrap.cc:492] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: No bootstrap required, opened a new log
I20260809 19:01:10.567296 13476 ts_tablet_manager.cc:1397] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260809 19:01:10.568318 13472 raft_consensus.cc:348] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.568717 13472 raft_consensus.cc:374] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:10.568809 13472 raft_consensus.cc:729] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a71c8106445b433e87101feda91cdc9b, State: Initialized, Role: FOLLOWER
I20260809 19:01:10.569422 13472 consensus_queue.cc:260] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.572554 13229 heartbeater.cc:503] Master 127.16.188.254:33593 was elected leader, sending a full tablet report...
I20260809 19:01:10.573120 13472 ts_tablet_manager.cc:1428] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: Time spent starting tablet: real 0.015s user 0.010s sys 0.003s
I20260809 19:01:10.575402 13476 raft_consensus.cc:348] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.575881 13476 raft_consensus.cc:374] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:10.576022 13476 raft_consensus.cc:729] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90013bfb3b0c47e4bbfa7c9b6780bd5a, State: Initialized, Role: FOLLOWER
I20260809 19:01:10.576793 13476 consensus_queue.cc:260] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.577478 13473 raft_consensus.cc:348] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.577946 13473 raft_consensus.cc:374] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:10.578060 13473 raft_consensus.cc:729] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3834dca3e9754ea389e8a424973905e7, State: Initialized, Role: FOLLOWER
I20260809 19:01:10.578689 13473 consensus_queue.cc:260] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.580528 13442 heartbeater.cc:503] Master 127.16.188.254:33593 was elected leader, sending a full tablet report...
I20260809 19:01:10.581187 13476 ts_tablet_manager.cc:1428] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
I20260809 19:01:10.582605 13020 heartbeater.cc:503] Master 127.16.188.254:33593 was elected leader, sending a full tablet report...
I20260809 19:01:10.583189 13473 ts_tablet_manager.cc:1428] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: Time spent starting tablet: real 0.019s user 0.015s sys 0.002s
I20260809 19:01:10.653127 13485 raft_consensus.cc:482] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:01:10.653432 13485 raft_consensus.cc:504] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.655068 13485 leader_election.cc:288] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90013bfb3b0c47e4bbfa7c9b6780bd5a (127.16.188.195:35755), a71c8106445b433e87101feda91cdc9b (127.16.188.194:33365)
I20260809 19:01:10.661583 13469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.655565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:46923 (local address 127.16.188.194:33365)
0809 19:01:10.655770 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.655778 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.656445 (+ 667us) server_negotiation.cc:407] Connection header received
0809 19:01:10.656615 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.656621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.656688 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.656770 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:10.657356 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.658043 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.659969 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.660703 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.660861 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.660934 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.661217 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.661337 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:01:10.661610 13465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.655733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:60995 (local address 127.16.188.195:35755)
0809 19:01:10.655964 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.655970 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.656472 (+ 502us) server_negotiation.cc:407] Connection header received
0809 19:01:10.656641 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.656644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.656704 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.656780 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:10.657463 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.658157 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.659959 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.660713 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.660866 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.660934 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.661250 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.661369 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 19:01:10.661705 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.655341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:33365 (local address 127.16.188.193:46923)
0809 19:01:10.656325 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.656344 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.656480 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.656790 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.656795 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.656817 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:10.657213 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.657222 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.658175 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.658180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.659772 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.659784 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.660884 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.660891 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.661058 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.661081 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.661187 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.661326 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":89,"thread_start_us":613,"threads_started":1}
I20260809 19:01:10.661746 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.655485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:35755 (local address 127.16.188.193:60995)
0809 19:01:10.656363 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:10.656377 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:10.656498 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:10.656805 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:10.656809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:10.656832 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:10.657299 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.657308 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.658285 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.658289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.659764 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:10.659776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.660935 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.660943 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:10.661080 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.661130 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 19:01:10.661208 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 19:01:10.661330 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"mutex_wait_us":4,"thread_start_us":542,"threads_started":1}
I20260809 19:01:10.662670 13150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a59aec7440f445edbb0ea7fde8e2b651" candidate_uuid: "3834dca3e9754ea389e8a424973905e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a71c8106445b433e87101feda91cdc9b" is_pre_election: true
I20260809 19:01:10.663070 13370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a59aec7440f445edbb0ea7fde8e2b651" candidate_uuid: "3834dca3e9754ea389e8a424973905e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" is_pre_election: true
I20260809 19:01:10.663317 13150 raft_consensus.cc:2454] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3834dca3e9754ea389e8a424973905e7 in term 0.
I20260809 19:01:10.663645 13370 raft_consensus.cc:2454] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3834dca3e9754ea389e8a424973905e7 in term 0.
I20260809 19:01:10.663996 12837 leader_election.cc:302] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3834dca3e9754ea389e8a424973905e7, a71c8106445b433e87101feda91cdc9b; no voters:
I20260809 19:01:10.664427 13485 raft_consensus.cc:2781] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:01:10.664557 13485 raft_consensus.cc:482] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:01:10.664654 13485 raft_consensus.cc:3037] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:10.666808 13485 raft_consensus.cc:504] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.667418 13485 leader_election.cc:288] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [CANDIDATE]: Term 1 election: Requested vote from peers 90013bfb3b0c47e4bbfa7c9b6780bd5a (127.16.188.195:35755), a71c8106445b433e87101feda91cdc9b (127.16.188.194:33365)
I20260809 19:01:10.667769 13370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a59aec7440f445edbb0ea7fde8e2b651" candidate_uuid: "3834dca3e9754ea389e8a424973905e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a"
I20260809 19:01:10.667901 13150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a59aec7440f445edbb0ea7fde8e2b651" candidate_uuid: "3834dca3e9754ea389e8a424973905e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a71c8106445b433e87101feda91cdc9b"
I20260809 19:01:10.667971 13370 raft_consensus.cc:3037] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:10.668095 13150 raft_consensus.cc:3037] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:10.671145 13370 raft_consensus.cc:2454] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3834dca3e9754ea389e8a424973905e7 in term 1.
I20260809 19:01:10.671155 13150 raft_consensus.cc:2454] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3834dca3e9754ea389e8a424973905e7 in term 1.
I20260809 19:01:10.671516 12837 leader_election.cc:302] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3834dca3e9754ea389e8a424973905e7, a71c8106445b433e87101feda91cdc9b; no voters:
I20260809 19:01:10.671794 13485 raft_consensus.cc:2781] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:10.672219 13485 raft_consensus.cc:686] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 1 LEADER]: Becoming Leader. State: Replica: 3834dca3e9754ea389e8a424973905e7, State: Running, Role: LEADER
I20260809 19:01:10.672734 13485 consensus_queue.cc:237] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } }
I20260809 19:01:10.677238 12713 catalog_manager.cc:5495] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3834dca3e9754ea389e8a424973905e7 (127.16.188.193). New cstate: current_term: 1 leader_uuid: "3834dca3e9754ea389e8a424973905e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3834dca3e9754ea389e8a424973905e7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 43379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 } health_report { overall_health: UNKNOWN } } }
W20260809 19:01:10.703146 13443 tablet.cc:2369] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:10.723461 13464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.718500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53758 (local address 127.16.188.193:43379)
0809 19:01:10.718723 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.718730 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.718755 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:01:10.718943 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.718947 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.719043 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.719165 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:10.719426 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.720128 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.721549 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.721963 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.722061 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.722464 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:10.722971 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:10.723077 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.723130 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.723193 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:01:10.731117 13370 raft_consensus.cc:1261] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 1 FOLLOWER]: Refusing update from remote peer 3834dca3e9754ea389e8a424973905e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:10.731124 13150 raft_consensus.cc:1261] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 1 FOLLOWER]: Refusing update from remote peer 3834dca3e9754ea389e8a424973905e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:10.731974 13489 consensus_queue.cc:1035] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90013bfb3b0c47e4bbfa7c9b6780bd5a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 35755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:10.732303 13485 consensus_queue.cc:1035] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a71c8106445b433e87101feda91cdc9b" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 33365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:10.751062 13495 mvcc.cc:205] Tried to move back new op lower bound from 7316693281704943616 to 7316693281478750208. Current Snapshot: MvccSnapshot[applied={T|T < 7316693281704943616}]
I20260809 19:01:10.755748 12713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:10.755960 12713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:10.759276 12713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 85176c7af3544b8fa0af91e46c3782c1: Sending DeleteTablet for 3 replicas of tablet a59aec7440f445edbb0ea7fde8e2b651
I20260809 19:01:10.760341 13333 tablet_service.cc:1514] Processing DeleteTablet for tablet a59aec7440f445edbb0ea7fde8e2b651 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:10 UTC) from {username='slave'} at 127.0.0.1:36540
I20260809 19:01:10.760419 12915 tablet_service.cc:1514] Processing DeleteTablet for tablet a59aec7440f445edbb0ea7fde8e2b651 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:10 UTC) from {username='slave'} at 127.0.0.1:53744
I20260809 19:01:10.760468 13120 tablet_service.cc:1514] Processing DeleteTablet for tablet a59aec7440f445edbb0ea7fde8e2b651 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:10 UTC) from {username='slave'} at 127.0.0.1:46580
I20260809 19:01:10.761379 13508 tablet_replica.cc:330] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: stopping tablet replica
I20260809 19:01:10.761806 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 12804
I20260809 19:01:10.761833 13508 raft_consensus.cc:2229] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:10.762283 13508 raft_consensus.cc:2258] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:10.765535 13508 ts_tablet_manager.cc:1905] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:10.772475 13512 tablet_replica.cc:330] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: stopping tablet replica
I20260809 19:01:10.772605 13508 ts_tablet_manager.cc:1918] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:10.772790 13508 log.cc:1196] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/a59aec7440f445edbb0ea7fde8e2b651
I20260809 19:01:10.772886 13512 raft_consensus.cc:2229] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:01:10.773540 13508 ts_tablet_manager.cc:1939] T a59aec7440f445edbb0ea7fde8e2b651 P 90013bfb3b0c47e4bbfa7c9b6780bd5a: Deleting consensus metadata
I20260809 19:01:10.773648 13512 raft_consensus.cc:2258] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:10.774349 13509 tablet_replica.cc:330] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: stopping tablet replica
I20260809 19:01:10.774637 13509 raft_consensus.cc:2229] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:10.774996 13509 raft_consensus.cc:2258] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:10.775355 12697 catalog_manager.cc:4841] TS 90013bfb3b0c47e4bbfa7c9b6780bd5a (127.16.188.195:35755): tablet a59aec7440f445edbb0ea7fde8e2b651 (table test-table [id=f3ecfa63c41345f4b4f5d8c60f24e1ba]) successfully deleted
I20260809 19:01:10.775856 13512 ts_tablet_manager.cc:1905] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:10.778669 13509 ts_tablet_manager.cc:1905] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:10.782490 13512 ts_tablet_manager.cc:1918] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:10.782740 13512 log.cc:1196] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/a59aec7440f445edbb0ea7fde8e2b651
I20260809 19:01:10.783375 13512 ts_tablet_manager.cc:1939] T a59aec7440f445edbb0ea7fde8e2b651 P 3834dca3e9754ea389e8a424973905e7: Deleting consensus metadata
I20260809 19:01:10.785043 12695 catalog_manager.cc:4841] TS 3834dca3e9754ea389e8a424973905e7 (127.16.188.193:43379): tablet a59aec7440f445edbb0ea7fde8e2b651 (table test-table [id=f3ecfa63c41345f4b4f5d8c60f24e1ba]) successfully deleted
I20260809 19:01:10.785687 13509 ts_tablet_manager.cc:1918] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:10.785849 13509 log.cc:1196] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/a59aec7440f445edbb0ea7fde8e2b651
I20260809 19:01:10.786330 13509 ts_tablet_manager.cc:1939] T a59aec7440f445edbb0ea7fde8e2b651 P a71c8106445b433e87101feda91cdc9b: Deleting consensus metadata
I20260809 19:01:10.787652 12696 catalog_manager.cc:4841] TS a71c8106445b433e87101feda91cdc9b (127.16.188.194:33365): tablet a59aec7440f445edbb0ea7fde8e2b651 (table test-table [id=f3ecfa63c41345f4b4f5d8c60f24e1ba]) successfully deleted
I20260809 19:01:10.788157 13464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.763581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53760 (local address 127.16.188.193:43379)
0809 19:01:10.763810 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.763816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.780028 (+ 16212us) server_negotiation.cc:407] Connection header received
0809 19:01:10.780245 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.780251 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.780362 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.780482 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.780956 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.782208 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.784192 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.784835 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.784934 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.786475 (+ 1541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.786486 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.786504 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:10.787259 (+ 755us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.787328 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:10.787353 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.787442 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.787689 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.787792 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 19:01:10.789309 13012 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:10.882629 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 12804
I20260809 19:01:10.903191 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 13027
I20260809 19:01:10.909551 13469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:10.903899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46588 (local address 127.16.188.194:33365)
0809 19:01:10.904074 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:10.904098 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:10.904127 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:01:10.904308 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:10.904312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:10.904413 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:10.904496 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:10.904831 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.905619 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.906822 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:10.907212 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:10.907301 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:10.908177 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:10.908186 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:10.908200 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:10.908764 (+ 564us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:10.908811 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:10.908836 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:10.908917 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:10.909014 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 19:01:10.909225 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:01:10.910251 13219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:10.995404 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 13027
I20260809 19:01:11.024727 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 13233
I20260809 19:01:11.031126 13465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:11.025506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36548 (local address 127.16.188.195:35755)
0809 19:01:11.025712 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:11.025717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:11.025737 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:01:11.025855 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:11.025859 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:11.025947 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:11.026034 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:11.026377 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.027097 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.028254 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:11.028644 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:11.028737 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:11.029803 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:11.029812 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:11.029830 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:11.030401 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:11.030450 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:11.030472 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:11.030559 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:11.030705 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 19:01:11.030804 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 19:01:11.031788 13434 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:11.117866 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 13233
I20260809 19:01:11.141633 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 12669
I20260809 19:01:11.142635 12760 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:11.250612 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 12669
2026-08-09T19:01:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2752 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:11 dist-test-slave-266d krb5kdc[13522](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:11 dist-test-slave-266d krb5kdc[13522](info): set up 2 sockets
Aug 09 19:01:11 dist-test-slave-266d krb5kdc[13522](info): commencing operation
krb5kdc: starting...
W20260809 19:01:12.489782 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:12 dist-test-slave-266d krb5kdc[13522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:01:12.754340 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:34379
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:38361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:34379
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:13.093775 13542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:13.094076 13542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:13.094184 13542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:13.101387 13542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:13.101493 13542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:13.101554 13542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:13.101632 13542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:13.101682 13542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:13.111614 13542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:38361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:34379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:34379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:13.112891 13542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:13.114272 13542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:13.126070 13551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.126139 13552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.126515 13557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:13.127105 13542 server_base.cc:1034] running on GCE node
I20260809 19:01:13.127885 13542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:13.129402 13542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:13.130661 13542 hybrid_clock.cc:648] HybridClock initialized: now 1786302073130589 us; error 42 us; skew 500 ppm
I20260809 19:01:13.131026 13542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:13 dist-test-slave-266d krb5kdc[13522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:13.137307 13542 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:01:13.138779 13542 webserver.cc:460] Webserver started at http://127.16.188.254:33603/ using document root <none> and password file <none>
I20260809 19:01:13.139439 13542 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:13.139549 13542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:13.139912 13542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:13.143008 13542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "aa57aa40af504cc5815d2145ea68c9d8"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-266d"
server_key: "42a95e5e2834663e1626dcc4797aba55"
server_key_iv: "4f5803ea163fa2c7e26de915c53c4e8b"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.143767 13542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "aa57aa40af504cc5815d2145ea68c9d8"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-266d"
server_key: "42a95e5e2834663e1626dcc4797aba55"
server_key_iv: "4f5803ea163fa2c7e26de915c53c4e8b"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.148939 13542 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 19:01:13.152326 13570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:13.153610 13542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:13.153746 13542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "aa57aa40af504cc5815d2145ea68c9d8"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-266d"
server_key: "42a95e5e2834663e1626dcc4797aba55"
server_key_iv: "4f5803ea163fa2c7e26de915c53c4e8b"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.153908 13542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:13.166097 13542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:13.170209 13542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:13.170441 13542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:13.187642 13542 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:34379
I20260809 19:01:13.187654 13657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:34379 every 8 connection(s)
I20260809 19:01:13.188970 13542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:13.192600 13658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:13.199117 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 13542
I20260809 19:01:13.199316 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:13.199905 17139 external_mini_cluster.cc:1428] Setting key 68837474021e4c143c0cf6ee5350907f
I20260809 19:01:13.203400 13658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8: Bootstrap starting.
I20260809 19:01:13.206892 13658 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:13.207899 13658 log.cc:824] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:13.210812 13658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8: No bootstrap required, opened a new log
Aug 09 19:01:13 dist-test-slave-266d krb5kdc[13522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:13.219146 13658 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57aa40af504cc5815d2145ea68c9d8" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34379 } }
I20260809 19:01:13.219506 13658 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:13.219602 13658 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa57aa40af504cc5815d2145ea68c9d8, State: Initialized, Role: FOLLOWER
I20260809 19:01:13.220136 13658 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57aa40af504cc5815d2145ea68c9d8" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34379 } }
I20260809 19:01:13.220381 13658 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:13.220515 13658 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:13.220693 13658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:13.222489 13663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.201735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46830 (local address 127.16.188.254:34379)
0809 19:01:13.202468 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.202479 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.202518 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:01:13.204322 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.204346 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.204697 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.205019 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.206841 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.208134 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.209847 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.210482 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.210606 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.215137 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.215147 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.215160 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.215197 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.218210 (+ 3013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.218840 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.218847 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.218853 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.219010 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.219376 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.219380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.219382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.220024 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.220325 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.220730 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.221175 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":320,"threads_started":1}
I20260809 19:01:13.223446 13658 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57aa40af504cc5815d2145ea68c9d8" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34379 } }
I20260809 19:01:13.223905 13658 leader_election.cc:302] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa57aa40af504cc5815d2145ea68c9d8; no voters:
I20260809 19:01:13.224512 13658 leader_election.cc:288] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:13.224632 13666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:13.226717 13658 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:13.229339 13666 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [term 1 LEADER]: Becoming Leader. State: Replica: aa57aa40af504cc5815d2145ea68c9d8, State: Running, Role: LEADER
I20260809 19:01:13.230026 13666 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57aa40af504cc5815d2145ea68c9d8" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34379 } }
I20260809 19:01:13.232878 13671 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa57aa40af504cc5815d2145ea68c9d8. Latest consensus state: current_term: 1 leader_uuid: "aa57aa40af504cc5815d2145ea68c9d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57aa40af504cc5815d2145ea68c9d8" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34379 } } }
I20260809 19:01:13.232952 13668 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa57aa40af504cc5815d2145ea68c9d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57aa40af504cc5815d2145ea68c9d8" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34379 } } }
I20260809 19:01:13.233369 13671 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:13.233376 13668 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:13.235081 13678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:13.239369 13678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:13.247741 13678 catalog_manager.cc:1347] Generated new cluster ID: d6bcb5ef9b514b21acb44230dffb1e7a
I20260809 19:01:13.247870 13678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:13.265064 13678 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:13.266317 13678 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:13.277959 13678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8: Generated new TSK 0
I20260809 19:01:13.278867 13678 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 19:01:13.347702 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34379
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:38361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:13.677302 13701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:13.677567 13701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:13.677695 13701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:13.685056 13701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:13.685194 13701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:13.685359 13701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:01:13.694793 13701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:38361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34379
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:13.696079 13701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:13.697466 13701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:13.709729 13715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.709761 13719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:13.710347 13712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:13.710740 13701 server_base.cc:1034] running on GCE node
I20260809 19:01:13.711299 13701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:13.712152 13701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:13.713346 13701 hybrid_clock.cc:648] HybridClock initialized: now 1786302073713290 us; error 45 us; skew 500 ppm
I20260809 19:01:13.713630 13701 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:13 dist-test-slave-266d krb5kdc[13522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:13.716492 13701 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 19:01:13.717887 13701 webserver.cc:460] Webserver started at http://127.16.188.193:39183/ using document root <none> and password file <none>
I20260809 19:01:13.718501 13701 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:13.718600 13701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:13.718856 13701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:13.721762 13701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "f1e126008e4c4449abcfe66953a77039"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-266d"
server_key: "e26c50790d17fa8e106e28a79bc0bc43"
server_key_iv: "16f0b32808d6dd747a53e998d215750c"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.722469 13701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "f1e126008e4c4449abcfe66953a77039"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-266d"
server_key: "e26c50790d17fa8e106e28a79bc0bc43"
server_key_iv: "16f0b32808d6dd747a53e998d215750c"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.727591 13701 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:01:13.730796 13730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:13.731954 13701 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:01:13.732091 13701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "f1e126008e4c4449abcfe66953a77039"
format_stamp: "Formatted at 2026-08-09 19:01:13 on dist-test-slave-266d"
server_key: "e26c50790d17fa8e106e28a79bc0bc43"
server_key_iv: "16f0b32808d6dd747a53e998d215750c"
server_key_version: "encryptionkey@0"
I20260809 19:01:13.732251 13701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:13.749207 13701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:13.752688 13701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:13.752911 13701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:13.753803 13701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:13.755278 13701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:13.755350 13701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:13.755443 13701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:13.755486 13701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:13.785401 13701 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:46459
I20260809 19:01:13.785450 13905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:46459 every 8 connection(s)
I20260809 19:01:13.786650 13701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:01:13.793944 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 13701
I20260809 19:01:13.794114 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 19:01:13.794536 17139 external_mini_cluster.cc:1428] Setting key c8467a53273dd0a43a44028db1ea9669
Aug 09 19:01:13 dist-test-slave-266d krb5kdc[13522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302073, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:13.807010 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.789016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:53145 (local address 127.16.188.254:34379)
0809 19:01:13.789472 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:13.789477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:13.790306 (+ 829us) server_negotiation.cc:407] Connection header received
0809 19:01:13.792075 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:13.792082 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:13.792164 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:13.792262 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:13.793755 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.794531 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.796450 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.797015 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.797190 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.800727 (+ 3537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:13.800734 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:13.800740 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:13.800788 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:13.803750 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.804574 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.804579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.804583 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.804720 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:13.805180 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:13.805184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:13.805187 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:13.805513 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:13.805663 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:13.806426 (+ 763us) server_negotiation.cc:299] Negotiation successful
0809 19:01:13.806644 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":256,"threads_started":1}
I20260809 19:01:13.808077 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:13.789463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:34379 (local address 127.16.188.193:53145)
0809 19:01:13.790150 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:13.790188 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:13.791804 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:13.792495 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:13.792503 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:13.792983 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:13.793583 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.793601 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.794699 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.794703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.796321 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:13.796338 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:13.797251 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:13.797256 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:13.797455 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:13.798075 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:13.798099 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:13.800472 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:13.803898 (+ 3426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.803907 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.803922 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.804457 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.804819 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:13.804824 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:13.804827 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:13.805064 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:13.805650 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:13.805657 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:13.806050 (+ 393us) client_negotiation.cc:769] Sending connection context
0809 19:01:13.806325 (+ 275us) client_negotiation.cc:240] Negotiation successful
0809 19:01:13.806823 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":247,"threads_started":1}
I20260809 19:01:13.809672 13906 heartbeater.cc:347] Connected to a master server at 127.16.188.254:34379
I20260809 19:01:13.810039 13906 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:13.810997 13906 heartbeater.cc:511] Master 127.16.188.254:34379 requested a full tablet report, sending...
I20260809 19:01:13.813230 13603 ts_manager.cc:194] Registered new tserver with Master: f1e126008e4c4449abcfe66953a77039 (127.16.188.193:46459)
I20260809 19:01:13.814627 13603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:53145
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 19:01:13.858348 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34379
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:38361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:14.187430 13916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:14.187736 13916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:14.187897 13916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:14.195182 13916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:14.195314 13916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:14.195477 13916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:01:14.205407 13916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:38361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34379
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:14.206696 13916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:14.208014 13916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:14.221185 13924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:14.221331 13929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:14.221217 13923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:14.222340 13916 server_base.cc:1034] running on GCE node
I20260809 19:01:14.222975 13916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:14.223981 13916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:14.225206 13916 hybrid_clock.cc:648] HybridClock initialized: now 1786302074225150 us; error 38 us; skew 500 ppm
I20260809 19:01:14.225518 13916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:14 dist-test-slave-266d krb5kdc[13522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302074, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:14.228716 13916 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 19:01:14.230248 13916 webserver.cc:460] Webserver started at http://127.16.188.194:45761/ using document root <none> and password file <none>
I20260809 19:01:14.230931 13916 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:14.231045 13916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:14.231329 13916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:14.234354 13916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "ae2583ed4a204584b710dc9ffbb6ab06"
format_stamp: "Formatted at 2026-08-09 19:01:14 on dist-test-slave-266d"
server_key: "7b68e96afc32a81b0bf89634fc495375"
server_key_iv: "d64f8a27cde596f0fcb8d0f746cd3343"
server_key_version: "encryptionkey@0"
I20260809 19:01:14.235137 13916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "ae2583ed4a204584b710dc9ffbb6ab06"
format_stamp: "Formatted at 2026-08-09 19:01:14 on dist-test-slave-266d"
server_key: "7b68e96afc32a81b0bf89634fc495375"
server_key_iv: "d64f8a27cde596f0fcb8d0f746cd3343"
server_key_version: "encryptionkey@0"
I20260809 19:01:14.240530 13916 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 19:01:14.243999 13940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:14.245316 13916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:14.245482 13916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "ae2583ed4a204584b710dc9ffbb6ab06"
format_stamp: "Formatted at 2026-08-09 19:01:14 on dist-test-slave-266d"
server_key: "7b68e96afc32a81b0bf89634fc495375"
server_key_iv: "d64f8a27cde596f0fcb8d0f746cd3343"
server_key_version: "encryptionkey@0"
I20260809 19:01:14.245699 13916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:14.259740 13916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:14.263517 13916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:14.263814 13916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:14.264741 13916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:14.266124 13916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:14.266204 13916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:14.266335 13916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:14.266398 13916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:14.296784 13916 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:41565
I20260809 19:01:14.296836 14111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:41565 every 8 connection(s)
I20260809 19:01:14.298058 13916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:01:14.304888 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 13916
I20260809 19:01:14.305080 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 19:01:14.305608 17139 external_mini_cluster.cc:1428] Setting key 5142c340d618823121d2bc1ed663795f
Aug 09 19:01:14 dist-test-slave-266d krb5kdc[13522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302074, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:14.316733 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.300450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:40147 (local address 127.16.188.254:34379)
0809 19:01:14.300622 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.300627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.301791 (+ 1164us) server_negotiation.cc:407] Connection header received
0809 19:01:14.303561 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.303567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.303649 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.303737 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:14.305196 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.305903 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.307594 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.308018 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.308125 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.311446 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:14.311450 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:14.311454 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:14.311486 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:14.313927 (+ 2441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:14.314598 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:14.314602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:14.314604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:14.314728 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:14.315132 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:14.315135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:14.315137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:14.315387 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:14.315535 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.316166 (+ 631us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.316408 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:01:14.317623 14114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.300883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:34379 (local address 127.16.188.194:40147)
0809 19:01:14.301630 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:14.301667 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:14.303304 (+ 1637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:14.303968 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:14.303975 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:14.304445 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:14.304996 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.305017 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.306057 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.306063 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.307464 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.307476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.308227 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.308235 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.308450 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.309127 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:14.309154 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:14.311233 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:14.314053 (+ 2820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:14.314062 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:14.314076 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:14.314478 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:14.314833 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:14.314838 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:14.314842 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:14.315022 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:14.315507 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:14.315514 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:14.315827 (+ 313us) client_negotiation.cc:769] Sending connection context
0809 19:01:14.316037 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 19:01:14.316537 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":301,"threads_started":1}
I20260809 19:01:14.318979 14112 heartbeater.cc:347] Connected to a master server at 127.16.188.254:34379
I20260809 19:01:14.319247 14112 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:14.319922 14112 heartbeater.cc:511] Master 127.16.188.254:34379 requested a full tablet report, sending...
I20260809 19:01:14.321337 13603 ts_manager.cc:194] Registered new tserver with Master: ae2583ed4a204584b710dc9ffbb6ab06 (127.16.188.194:41565)
I20260809 19:01:14.322113 13603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:40147
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 19:01:14.367388 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34379
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:38361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:14.694412 14120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:14.694672 14120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:14.694772 14120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:14.701725 14120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:14.701818 14120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:14.701934 14120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:01:14.711246 14120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:38361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:34379
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:14.712406 14120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:14.713713 14120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:14.726013 14127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:14.726049 14128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:14.726101 14130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:14.726743 14120 server_base.cc:1034] running on GCE node
I20260809 19:01:14.727296 14120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:14.728192 14120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:14.729386 14120 hybrid_clock.cc:648] HybridClock initialized: now 1786302074729338 us; error 36 us; skew 500 ppm
I20260809 19:01:14.729653 14120 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:14 dist-test-slave-266d krb5kdc[13522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302074, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:14.732486 14120 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 19:01:14.733875 14120 webserver.cc:460] Webserver started at http://127.16.188.195:46357/ using document root <none> and password file <none>
I20260809 19:01:14.734505 14120 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:14.734602 14120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:14.734889 14120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:14.737848 14120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "88e8d804f05e43b686e647ebde5addee"
format_stamp: "Formatted at 2026-08-09 19:01:14 on dist-test-slave-266d"
server_key: "2b28b433f3932ee312ae5a052fdea93b"
server_key_iv: "2c164600929637a48dca205ee98299f7"
server_key_version: "encryptionkey@0"
I20260809 19:01:14.738541 14120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "88e8d804f05e43b686e647ebde5addee"
format_stamp: "Formatted at 2026-08-09 19:01:14 on dist-test-slave-266d"
server_key: "2b28b433f3932ee312ae5a052fdea93b"
server_key_iv: "2c164600929637a48dca205ee98299f7"
server_key_version: "encryptionkey@0"
I20260809 19:01:14.743408 14120 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260809 19:01:14.746645 14140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:14.747869 14120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:01:14.748013 14120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "88e8d804f05e43b686e647ebde5addee"
format_stamp: "Formatted at 2026-08-09 19:01:14 on dist-test-slave-266d"
server_key: "2b28b433f3932ee312ae5a052fdea93b"
server_key_iv: "2c164600929637a48dca205ee98299f7"
server_key_version: "encryptionkey@0"
I20260809 19:01:14.748178 14120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:14.777199 14120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:14.781255 14120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:14.781518 14120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:14.782444 14120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:14.783741 14120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:14.783839 14120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:14.783962 14120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:14.784024 14120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:14.814283 14120 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:34891
I20260809 19:01:14.814301 14317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:34891 every 8 connection(s)
I20260809 19:01:14.815496 14120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:01:14.818109 13906 heartbeater.cc:503] Master 127.16.188.254:34379 was elected leader, sending a full tablet report...
I20260809 19:01:14.824563 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 14120
I20260809 19:01:14.824728 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 19:01:14.825210 17139 external_mini_cluster.cc:1428] Setting key 01029e19d9b904c93884702f05f48311
Aug 09 19:01:14 dist-test-slave-266d krb5kdc[13522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302074, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:14.834025 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.817985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:53095 (local address 127.16.188.254:34379)
0809 19:01:14.818880 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.818887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.819405 (+ 518us) server_negotiation.cc:407] Connection header received
0809 19:01:14.821243 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.821249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.821344 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.821439 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:14.822898 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.823655 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.825230 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.825673 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.825787 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.829189 (+ 3402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:14.829194 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:14.829197 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:14.829228 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:14.831509 (+ 2281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:14.832125 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:14.832128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:14.832131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:14.832240 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:14.832555 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:14.832558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:14.832560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:14.832799 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:14.832905 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.833525 (+ 620us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.833694 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":767,"thread_start_us":651,"threads_started":1}
I20260809 19:01:14.834817 14322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.818516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:34379 (local address 127.16.188.195:53095)
0809 19:01:14.819252 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:14.819296 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:14.820977 (+ 1681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:14.821687 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:14.821695 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:14.822179 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:14.822733 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.822751 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.823803 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.823807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.825076 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.825113 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.825894 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.825902 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.826124 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.826789 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:14.826819 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:14.828989 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:14.831629 (+ 2640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:14.831636 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:14.831646 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:14.832038 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:14.832311 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:14.832314 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:14.832316 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:14.832482 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:14.832883 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:14.832888 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:14.833209 (+ 321us) client_negotiation.cc:769] Sending connection context
0809 19:01:14.833432 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 19:01:14.833774 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":343,"threads_started":1}
I20260809 19:01:14.836030 14318 heartbeater.cc:347] Connected to a master server at 127.16.188.254:34379
I20260809 19:01:14.836297 14318 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:14.836962 14318 heartbeater.cc:511] Master 127.16.188.254:34379 requested a full tablet report, sending...
I20260809 19:01:14.838335 13603 ts_manager.cc:194] Registered new tserver with Master: 88e8d804f05e43b686e647ebde5addee (127.16.188.195:34891)
I20260809 19:01:14.839358 13603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:53095
I20260809 19:01:14.840106 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:01:14.856256 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.844408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46832 (local address 127.16.188.254:34379)
0809 19:01:14.844588 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.844595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.844996 (+ 401us) server_negotiation.cc:407] Connection header received
0809 19:01:14.845142 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.845146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.845205 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.845276 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:14.846608 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.847323 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.848493 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.848906 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.848995 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.851477 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:14.851482 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:14.851485 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:14.851514 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:14.853922 (+ 2408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:14.854586 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:14.854589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:14.854592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:14.854717 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:14.855046 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:14.855049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:14.855051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:14.855323 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:14.855528 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.855795 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.855938 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:01:14.860198 13600 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:01:14.867151 13600 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:01:14.896458 14343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.880061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46624 (local address 127.16.188.195:34891)
0809 19:01:14.880753 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.880762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.888582 (+ 7820us) server_negotiation.cc:407] Connection header received
0809 19:01:14.888897 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.888906 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.889152 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.889319 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:14.890069 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.891505 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.894021 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.894971 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.895157 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.895323 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.895969 (+ 646us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.896122 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":464,"threads_started":1}
I20260809 19:01:14.896504 14337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.879402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:34891 (local address 127.0.0.1:46624)
0809 19:01:14.888464 (+ 9062us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:14.888481 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:14.888692 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:14.889555 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:14.889558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:14.889578 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:14.889870 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.889881 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.891644 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.891649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.893894 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.893904 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.895469 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.895476 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.895634 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.895753 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 19:01:14.895897 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 19:01:14.896055 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8954,"mutex_wait_us":62,"thread_start_us":5879,"threads_started":1}
I20260809 19:01:14.896659 14338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.878902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:41565 (local address 127.0.0.1:53272)
0809 19:01:14.887450 (+ 8548us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:14.887469 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:14.887623 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:14.888477 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:14.888485 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:14.888518 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:14.889179 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.889199 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.891199 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.891204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.893704 (+ 2500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.893719 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.895798 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.895805 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.895981 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.896012 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:01:14.896090 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 19:01:14.896206 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8439,"mutex_wait_us":77,"thread_start_us":8299,"threads_started":1}
I20260809 19:01:14.897137 14340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.879062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58270 (local address 127.16.188.193:46459)
0809 19:01:14.888164 (+ 9102us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.888172 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.888197 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:01:14.888299 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.888306 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.888522 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.888700 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:14.889407 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.891016 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.893448 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.894751 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.894950 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.895143 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.896194 (+ 1051us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.896377 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8945,"thread_start_us":8769,"threads_started":1}
I20260809 19:01:14.897389 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.879505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53272 (local address 127.16.188.194:41565)
0809 19:01:14.887813 (+ 8308us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:14.887821 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:14.887849 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:01:14.887955 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:14.887962 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:14.888201 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:14.888400 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:14.889361 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.891020 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.893895 (+ 2875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.895316 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.895473 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.895636 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:14.896900 (+ 1264us) server_negotiation.cc:299] Negotiation successful
0809 19:01:14.897057 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8139,"thread_start_us":7997,"threads_started":1}
I20260809 19:01:14.898362 14341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:14.878756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:46459 (local address 127.0.0.1:58270)
0809 19:01:14.886682 (+ 7926us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:14.886739 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:14.886919 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:14.888707 (+ 1788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:14.888716 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:14.888741 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:14.889210 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.889222 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.891163 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.891169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.893291 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:14.893304 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:14.895308 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:14.895315 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:14.895524 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:14.895577 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 19:01:14.895699 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 19:01:14.895896 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6656,"mutex_wait_us":217,"thread_start_us":9455,"threads_started":1}
I20260809 19:01:14.900367 14216 tablet_service.cc:1467] Processing CreateTablet for tablet 699b03bec3ae4073ab92c7a7a586facb (DEFAULT_TABLE table=test-table [id=80a18b30b66e4f6a9bb13b9a21702e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:14.900817 14013 tablet_service.cc:1467] Processing CreateTablet for tablet 699b03bec3ae4073ab92c7a7a586facb (DEFAULT_TABLE table=test-table [id=80a18b30b66e4f6a9bb13b9a21702e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:14.901976 14216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 699b03bec3ae4073ab92c7a7a586facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:14.902252 14013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 699b03bec3ae4073ab92c7a7a586facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:14.901799 13808 tablet_service.cc:1467] Processing CreateTablet for tablet 699b03bec3ae4073ab92c7a7a586facb (DEFAULT_TABLE table=test-table [id=80a18b30b66e4f6a9bb13b9a21702e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:14.903146 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 699b03bec3ae4073ab92c7a7a586facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:14.912655 14344 tablet_bootstrap.cc:492] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Bootstrap starting.
I20260809 19:01:14.915891 14344 tablet_bootstrap.cc:654] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:14.916254 14346 tablet_bootstrap.cc:492] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Bootstrap starting.
I20260809 19:01:14.918332 14344 log.cc:824] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:14.919588 14346 tablet_bootstrap.cc:654] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:14.919698 14347 tablet_bootstrap.cc:492] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Bootstrap starting.
I20260809 19:01:14.921597 14346 log.cc:824] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:14.921695 14344 tablet_bootstrap.cc:492] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: No bootstrap required, opened a new log
I20260809 19:01:14.921950 14344 ts_tablet_manager.cc:1397] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 19:01:14.923539 14347 tablet_bootstrap.cc:654] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:14.924718 14347 log.cc:824] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:14.926508 14346 tablet_bootstrap.cc:492] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: No bootstrap required, opened a new log
I20260809 19:01:14.926779 14346 ts_tablet_manager.cc:1397] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260809 19:01:14.932211 14344 raft_consensus.cc:348] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:14.932626 14344 raft_consensus.cc:374] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:14.932723 14344 raft_consensus.cc:729] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e8d804f05e43b686e647ebde5addee, State: Initialized, Role: FOLLOWER
I20260809 19:01:14.933468 14344 consensus_queue.cc:260] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:14.934593 14318 heartbeater.cc:503] Master 127.16.188.254:34379 was elected leader, sending a full tablet report...
I20260809 19:01:14.935335 14347 tablet_bootstrap.cc:492] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: No bootstrap required, opened a new log
I20260809 19:01:14.935581 14347 ts_tablet_manager.cc:1397] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.007s
I20260809 19:01:14.936681 14346 raft_consensus.cc:348] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:14.937124 14346 raft_consensus.cc:374] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:14.937230 14346 raft_consensus.cc:729] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae2583ed4a204584b710dc9ffbb6ab06, State: Initialized, Role: FOLLOWER
I20260809 19:01:14.937836 14346 consensus_queue.cc:260] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:14.938936 14112 heartbeater.cc:503] Master 127.16.188.254:34379 was elected leader, sending a full tablet report...
I20260809 19:01:14.939786 14344 ts_tablet_manager.cc:1428] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Time spent starting tablet: real 0.018s user 0.013s sys 0.000s
I20260809 19:01:14.940842 14346 ts_tablet_manager.cc:1428] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260809 19:01:14.944696 14347 raft_consensus.cc:348] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:14.945065 14347 raft_consensus.cc:374] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:14.945192 14347 raft_consensus.cc:729] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e126008e4c4449abcfe66953a77039, State: Initialized, Role: FOLLOWER
I20260809 19:01:14.945750 14347 consensus_queue.cc:260] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:14.947173 14347 ts_tablet_manager.cc:1428] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Time spent starting tablet: real 0.011s user 0.008s sys 0.003s
W20260809 19:01:15.038757 13907 tablet.cc:2369] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:01:15.049930 14113 tablet.cc:2369] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:15.061594 14354 raft_consensus.cc:482] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:01:15.061868 14354 raft_consensus.cc:504] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:15.063539 14354 leader_election.cc:288] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1e126008e4c4449abcfe66953a77039 (127.16.188.193:46459), 88e8d804f05e43b686e647ebde5addee (127.16.188.195:34891)
W20260809 19:01:15.067085 14319 tablet.cc:2369] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:15.070582 14340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:15.063946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:55879 (local address 127.16.188.193:46459)
0809 19:01:15.064167 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:15.064174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:15.064913 (+ 739us) server_negotiation.cc:407] Connection header received
0809 19:01:15.065135 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:15.065139 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:15.065201 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:15.065269 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:15.065854 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.066584 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.068858 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.069661 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.069790 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:15.069865 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:15.070224 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 19:01:15.070348 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:01:15.070601 14343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:15.064028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:44289 (local address 127.16.188.195:34891)
0809 19:01:15.064241 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:15.064248 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:15.064975 (+ 727us) server_negotiation.cc:407] Connection header received
0809 19:01:15.065151 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:15.065156 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:15.065216 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:15.065301 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:15.065948 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.066625 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.068906 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.069691 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.069855 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:15.069926 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:15.070254 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 19:01:15.070370 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:01:15.070696 14356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:15.063784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:46459 (local address 127.16.188.194:55879)
0809 19:01:15.064795 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:15.064811 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:15.064949 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:15.065316 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:15.065320 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:15.065343 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:15.065712 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:15.065724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.066718 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.066723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:15.068709 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:15.068721 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.069886 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.069892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:15.070072 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:15.070100 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 19:01:15.070169 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 19:01:15.070294 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":902,"mutex_wait_us":2,"thread_start_us":649,"threads_started":1}
I20260809 19:01:15.071077 14358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:15.063795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:34891 (local address 127.16.188.194:44289)
0809 19:01:15.064847 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:15.064864 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:15.064995 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:15.065330 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:15.065334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:15.065356 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:15.065773 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:15.065784 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.066765 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.066772 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:15.068750 (+ 1978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:15.068763 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.069920 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.069927 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:15.070103 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:15.070128 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 19:01:15.070216 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 19:01:15.070347 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":956,"mutex_wait_us":35,"thread_start_us":715,"threads_started":1}
I20260809 19:01:15.071605 13845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "699b03bec3ae4073ab92c7a7a586facb" candidate_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e126008e4c4449abcfe66953a77039" is_pre_election: true
I20260809 19:01:15.071908 14246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "699b03bec3ae4073ab92c7a7a586facb" candidate_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e8d804f05e43b686e647ebde5addee" is_pre_election: true
I20260809 19:01:15.072068 13845 raft_consensus.cc:2454] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae2583ed4a204584b710dc9ffbb6ab06 in term 0.
I20260809 19:01:15.072338 14246 raft_consensus.cc:2454] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae2583ed4a204584b710dc9ffbb6ab06 in term 0.
I20260809 19:01:15.072719 13942 leader_election.cc:302] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae2583ed4a204584b710dc9ffbb6ab06, f1e126008e4c4449abcfe66953a77039; no voters:
I20260809 19:01:15.073117 14354 raft_consensus.cc:2781] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:01:15.073271 14354 raft_consensus.cc:482] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:01:15.073365 14354 raft_consensus.cc:3037] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:15.075417 14354 raft_consensus.cc:504] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:15.075980 14354 leader_election.cc:288] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [CANDIDATE]: Term 1 election: Requested vote from peers f1e126008e4c4449abcfe66953a77039 (127.16.188.193:46459), 88e8d804f05e43b686e647ebde5addee (127.16.188.195:34891)
I20260809 19:01:15.076300 13845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "699b03bec3ae4073ab92c7a7a586facb" candidate_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e126008e4c4449abcfe66953a77039"
I20260809 19:01:15.076469 13845 raft_consensus.cc:3037] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:15.076447 14246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "699b03bec3ae4073ab92c7a7a586facb" candidate_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e8d804f05e43b686e647ebde5addee"
I20260809 19:01:15.076619 14246 raft_consensus.cc:3037] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:15.078604 13845 raft_consensus.cc:2454] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae2583ed4a204584b710dc9ffbb6ab06 in term 1.
I20260809 19:01:15.078924 13942 leader_election.cc:302] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae2583ed4a204584b710dc9ffbb6ab06, f1e126008e4c4449abcfe66953a77039; no voters:
I20260809 19:01:15.078950 14246 raft_consensus.cc:2454] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae2583ed4a204584b710dc9ffbb6ab06 in term 1.
I20260809 19:01:15.079187 14354 raft_consensus.cc:2781] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:15.079620 14354 raft_consensus.cc:686] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 1 LEADER]: Becoming Leader. State: Replica: ae2583ed4a204584b710dc9ffbb6ab06, State: Running, Role: LEADER
I20260809 19:01:15.080052 14354 consensus_queue.cc:237] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } }
I20260809 19:01:15.084534 13603 catalog_manager.cc:5495] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae2583ed4a204584b710dc9ffbb6ab06 (127.16.188.194). New cstate: current_term: 1 leader_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae2583ed4a204584b710dc9ffbb6ab06" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 41565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 } health_report { overall_health: UNKNOWN } } }
I20260809 19:01:15.125452 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:15.120305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53286 (local address 127.16.188.194:41565)
0809 19:01:15.120477 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:15.120481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:15.120498 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:01:15.120633 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:15.120637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:15.120712 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:15.120832 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:15.121257 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.122058 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.123358 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.123784 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.123884 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:15.124373 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:15.124902 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:15.125048 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:15.125176 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 19:01:15.125221 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:01:15.133373 13845 raft_consensus.cc:1261] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 1 FOLLOWER]: Refusing update from remote peer ae2583ed4a204584b710dc9ffbb6ab06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:15.133391 14246 raft_consensus.cc:1261] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 1 FOLLOWER]: Refusing update from remote peer ae2583ed4a204584b710dc9ffbb6ab06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:15.134347 14360 consensus_queue.cc:1035] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e8d804f05e43b686e647ebde5addee" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:15.134670 14354 consensus_queue.cc:1035] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1e126008e4c4449abcfe66953a77039" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:15.145277 14364 mvcc.cc:205] Tried to move back new op lower bound from 7316693299736469504 to 7316693299531436032. Current Snapshot: MvccSnapshot[applied={T|T < 7316693299736469504}]
I20260809 19:01:15.148277 14367 mvcc.cc:205] Tried to move back new op lower bound from 7316693299736469504 to 7316693299531436032. Current Snapshot: MvccSnapshot[applied={T|T < 7316693299736469504}]
I20260809 19:01:15.160655 13603 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:15.160926 13603 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:15.164489 13603 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aa57aa40af504cc5815d2145ea68c9d8: Sending DeleteTablet for 3 replicas of tablet 699b03bec3ae4073ab92c7a7a586facb
I20260809 19:01:15.165715 14013 tablet_service.cc:1514] Processing DeleteTablet for tablet 699b03bec3ae4073ab92c7a7a586facb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:15 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:53272
I20260809 19:01:15.165709 13808 tablet_service.cc:1514] Processing DeleteTablet for tablet 699b03bec3ae4073ab92c7a7a586facb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:15 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:58270
I20260809 19:01:15.165736 14216 tablet_service.cc:1514] Processing DeleteTablet for tablet 699b03bec3ae4073ab92c7a7a586facb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:15 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:46624
I20260809 19:01:15.170915 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 13701
I20260809 19:01:15.178103 14380 tablet_replica.cc:330] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: stopping tablet replica
I20260809 19:01:15.178568 14380 raft_consensus.cc:2229] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:15.179091 14380 raft_consensus.cc:2258] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:15.179867 14379 tablet_replica.cc:330] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: stopping tablet replica
I20260809 19:01:15.180306 14379 raft_consensus.cc:2229] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:01:15.180953 14379 raft_consensus.cc:2258] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:15.183187 14379 ts_tablet_manager.cc:1905] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:15.190341 14379 ts_tablet_manager.cc:1918] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:15.190502 14379 log.cc:1196] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/699b03bec3ae4073ab92c7a7a586facb
I20260809 19:01:15.191087 14379 ts_tablet_manager.cc:1939] T 699b03bec3ae4073ab92c7a7a586facb P ae2583ed4a204584b710dc9ffbb6ab06: Deleting consensus metadata
I20260809 19:01:15.191996 14380 ts_tablet_manager.cc:1905] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:15.192838 13575 catalog_manager.cc:4841] TS ae2583ed4a204584b710dc9ffbb6ab06 (127.16.188.194:41565): tablet 699b03bec3ae4073ab92c7a7a586facb (table test-table [id=80a18b30b66e4f6a9bb13b9a21702e82]) successfully deleted
Aug 09 19:01:15 dist-test-slave-266d krb5kdc[13522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 19:01:15.199908 14380 ts_tablet_manager.cc:1918] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:15.200083 14380 log.cc:1196] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/699b03bec3ae4073ab92c7a7a586facb
I20260809 19:01:15.200652 14380 ts_tablet_manager.cc:1939] T 699b03bec3ae4073ab92c7a7a586facb P f1e126008e4c4449abcfe66953a77039: Deleting consensus metadata
I20260809 19:01:15.202531 13573 catalog_manager.cc:4841] TS f1e126008e4c4449abcfe66953a77039 (127.16.188.193:46459): tablet 699b03bec3ae4073ab92c7a7a586facb (table test-table [id=80a18b30b66e4f6a9bb13b9a21702e82]) successfully deleted
I20260809 19:01:15.202951 14378 tablet_replica.cc:330] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: stopping tablet replica
I20260809 19:01:15.203498 14378 raft_consensus.cc:2229] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:15.204047 14378 raft_consensus.cc:2258] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:15.206169 14378 ts_tablet_manager.cc:1905] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:15.206939 14340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:15.172367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58276 (local address 127.16.188.193:46459)
0809 19:01:15.172592 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:15.172600 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:15.184620 (+ 12020us) server_negotiation.cc:407] Connection header received
0809 19:01:15.185110 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:15.185117 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:15.185199 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:15.185270 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:15.187035 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.188131 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.192217 (+ 4086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.192814 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.192911 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:15.198846 (+ 5935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:15.198860 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:15.198877 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:15.198918 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:15.202845 (+ 3927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:15.203950 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:15.203958 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:15.203961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:15.204195 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:15.204881 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:15.204886 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:15.204889 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:15.205372 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:15.205661 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:15.206367 (+ 706us) server_negotiation.cc:299] Negotiation successful
0809 19:01:15.206588 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 19:01:15.208491 13899 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:15.213053 14378 ts_tablet_manager.cc:1918] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:15.213282 14378 log.cc:1196] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/699b03bec3ae4073ab92c7a7a586facb
I20260809 19:01:15.213811 14378 ts_tablet_manager.cc:1939] T 699b03bec3ae4073ab92c7a7a586facb P 88e8d804f05e43b686e647ebde5addee: Deleting consensus metadata
I20260809 19:01:15.215965 13571 catalog_manager.cc:4841] TS 88e8d804f05e43b686e647ebde5addee (127.16.188.195:34891): tablet 699b03bec3ae4073ab92c7a7a586facb (table test-table [id=80a18b30b66e4f6a9bb13b9a21702e82]) successfully deleted
I20260809 19:01:15.355186 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 13701
I20260809 19:01:15.386711 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 13916
Aug 09 19:01:15 dist-test-slave-266d krb5kdc[13522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 19:01:15.404582 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:15.387695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53298 (local address 127.16.188.194:41565)
0809 19:01:15.387850 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:15.387854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:15.387873 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:01:15.388056 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:15.388060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:15.388135 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:15.388227 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:15.390021 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.390855 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.392797 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.393279 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.393377 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:15.398843 (+ 5466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:15.398855 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:15.398874 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:15.398920 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:15.401922 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:15.402720 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:15.402727 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:15.402729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:15.402866 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:15.403228 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:15.403231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:15.403233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:15.403555 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:15.403814 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:15.404149 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 19:01:15.404299 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:01:15.405449 14104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:15.518558 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 13916
I20260809 19:01:15.548949 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 14120
Aug 09 19:01:15 dist-test-slave-266d krb5kdc[13522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 19:01:15.564086 14343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:15.549788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46634 (local address 127.16.188.195:34891)
0809 19:01:15.549975 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:15.549981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:15.550038 (+ 57us) server_negotiation.cc:407] Connection header received
0809 19:01:15.550250 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:15.550254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:15.550323 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:15.550408 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:15.551738 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.552492 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.553860 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:15.554243 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:15.554353 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:15.558758 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:15.558772 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:15.558789 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:15.558828 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:15.561502 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:15.562098 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:15.562106 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:15.562108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:15.562257 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:15.562608 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:15.562612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:15.562614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:15.562968 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:15.563238 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:15.563561 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 19:01:15.563789 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:01:15.564725 14311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:15.652987 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 14120
I20260809 19:01:15.679392 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 13542
I20260809 19:01:15.680402 13651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:15.789878 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 13542
2026-08-09T19:01:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4539 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T19:01:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:15Z Disabled control of system clock
I20260809 19:01:15.885207 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:35713
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:37749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:35713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:01:16.209911 14396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:16.210211 14396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:16.210338 14396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:16.217536 14396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:16.217649 14396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:16.217720 14396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:16.217794 14396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:16.217849 14396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:16.226841 14396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:35713
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:35713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:16.228117 14396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:16.229888 14396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:16.241204 14402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:16.241150 14409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:16.241235 14404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:16.242038 14396 server_base.cc:1034] running on GCE node
I20260809 19:01:16.242766 14396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:16.244056 14396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:16.245251 14396 hybrid_clock.cc:648] HybridClock initialized: now 1786302076245200 us; error 32 us; skew 500 ppm
I20260809 19:01:16.245596 14396 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:16.247720 14396 webserver.cc:460] Webserver started at http://127.16.188.254:35905/ using document root <none> and password file <none>
I20260809 19:01:16.248358 14396 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:16.248453 14396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:16.248766 14396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:16.251633 14396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "303b3a70784841fa9fd5e666741a4434"
format_stamp: "Formatted at 2026-08-09 19:01:16 on dist-test-slave-266d"
server_key: "6deefaa128d00cadb875709c75638d1f"
server_key_iv: "33f085cd311fbfd25c403034ec52fb27"
server_key_version: "encryptionkey@0"
I20260809 19:01:16.252429 14396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "303b3a70784841fa9fd5e666741a4434"
format_stamp: "Formatted at 2026-08-09 19:01:16 on dist-test-slave-266d"
server_key: "6deefaa128d00cadb875709c75638d1f"
server_key_iv: "33f085cd311fbfd25c403034ec52fb27"
server_key_version: "encryptionkey@0"
I20260809 19:01:16.257352 14396 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 19:01:16.260608 14419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:16.261884 14396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:16.262058 14396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "303b3a70784841fa9fd5e666741a4434"
format_stamp: "Formatted at 2026-08-09 19:01:16 on dist-test-slave-266d"
server_key: "6deefaa128d00cadb875709c75638d1f"
server_key_iv: "33f085cd311fbfd25c403034ec52fb27"
server_key_version: "encryptionkey@0"
I20260809 19:01:16.262257 14396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:16.294993 14396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:16.295847 14396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:16.296113 14396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:16.313474 14396 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:35713
I20260809 19:01:16.313505 14496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:35713 every 8 connection(s)
I20260809 19:01:16.314798 14396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:16.318625 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 14396
I20260809 19:01:16.318647 14499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:16.318810 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:16.319291 17139 external_mini_cluster.cc:1428] Setting key 47c4d08b02fa2687925f5ab65f49a735
I20260809 19:01:16.331696 14499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434: Bootstrap starting.
I20260809 19:01:16.333587 14503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:16.321214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52172 (local address 127.16.188.254:35713)
0809 19:01:16.322299 (+ 1085us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:16.322310 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:16.322360 (+ 50us) server_negotiation.cc:407] Connection header received
0809 19:01:16.324551 (+ 2191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:16.324583 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:16.325046 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:16.325462 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:16.326008 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:16.327310 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:16.329219 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:16.329946 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:16.330094 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:16.331305 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:16.331317 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:16.331331 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:16.331879 (+ 548us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:16.331960 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:16.331982 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:16.332072 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:16.332315 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 19:01:16.332638 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":423,"threads_started":1}
I20260809 19:01:16.335161 14499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:16.336196 14499 log.cc:824] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:16.338819 14499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434: No bootstrap required, opened a new log
I20260809 19:01:16.345927 14499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b3a70784841fa9fd5e666741a4434" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35713 } }
I20260809 19:01:16.346246 14499 raft_consensus.cc:374] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:16.346350 14499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 303b3a70784841fa9fd5e666741a4434, State: Initialized, Role: FOLLOWER
I20260809 19:01:16.346868 14499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b3a70784841fa9fd5e666741a4434" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35713 } }
I20260809 19:01:16.347080 14499 raft_consensus.cc:388] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:16.347208 14499 raft_consensus.cc:482] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:16.347362 14499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:16.349494 14499 raft_consensus.cc:504] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b3a70784841fa9fd5e666741a4434" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35713 } }
I20260809 19:01:16.349970 14499 leader_election.cc:302] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 303b3a70784841fa9fd5e666741a4434; no voters:
I20260809 19:01:16.350528 14499 leader_election.cc:288] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:16.350692 14506 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:16.351456 14506 raft_consensus.cc:686] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [term 1 LEADER]: Becoming Leader. State: Replica: 303b3a70784841fa9fd5e666741a4434, State: Running, Role: LEADER
I20260809 19:01:16.352010 14506 consensus_queue.cc:237] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b3a70784841fa9fd5e666741a4434" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35713 } }
I20260809 19:01:16.352428 14499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:16.354640 14510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 303b3a70784841fa9fd5e666741a4434. Latest consensus state: current_term: 1 leader_uuid: "303b3a70784841fa9fd5e666741a4434" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b3a70784841fa9fd5e666741a4434" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35713 } } }
I20260809 19:01:16.355084 14510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:16.357182 14514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:16.356799 14508 sys_catalog.cc:455] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "303b3a70784841fa9fd5e666741a4434" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b3a70784841fa9fd5e666741a4434" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 35713 } } }
I20260809 19:01:16.357366 14508 sys_catalog.cc:458] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:16.362627 14514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:16.370970 14514 catalog_manager.cc:1347] Generated new cluster ID: ea89470432b146dda82fef8197f0c541
I20260809 19:01:16.371073 14514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:16.383775 14514 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:16.384929 14514 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:16.397651 14514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434: Generated new TSK 0
I20260809 19:01:16.398571 14514 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:16.414170 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35713
--builtin_ntp_servers=127.16.188.212:37749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:01:16.773635 14535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:16.773892 14535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:16.774013 14535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:16.781005 14535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:16.781112 14535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:16.781237 14535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:01:16.789896 14535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:16.791031 14535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:16.792665 14535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:16.804929 14544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:16.804901 14547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:16.805495 14545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:16.805689 14535 server_base.cc:1034] running on GCE node
I20260809 19:01:16.806232 14535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:16.807111 14535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:16.808306 14535 hybrid_clock.cc:648] HybridClock initialized: now 1786302076808270 us; error 29 us; skew 500 ppm
I20260809 19:01:16.808586 14535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:16.810618 14535 webserver.cc:460] Webserver started at http://127.16.188.193:35021/ using document root <none> and password file <none>
I20260809 19:01:16.811219 14535 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:16.811321 14535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:16.811610 14535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:16.814630 14535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "aedc74fa19214e32912bc17e4a274ff8"
format_stamp: "Formatted at 2026-08-09 19:01:16 on dist-test-slave-266d"
server_key: "c9d2ced9210a38b92dda86613dfde10c"
server_key_iv: "1e4c2f7ece04f4326b96c4338266fea5"
server_key_version: "encryptionkey@0"
I20260809 19:01:16.815439 14535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "aedc74fa19214e32912bc17e4a274ff8"
format_stamp: "Formatted at 2026-08-09 19:01:16 on dist-test-slave-266d"
server_key: "c9d2ced9210a38b92dda86613dfde10c"
server_key_iv: "1e4c2f7ece04f4326b96c4338266fea5"
server_key_version: "encryptionkey@0"
I20260809 19:01:16.820096 14535 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 19:01:16.823238 14557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:16.824390 14535 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 19:01:16.824540 14535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "aedc74fa19214e32912bc17e4a274ff8"
format_stamp: "Formatted at 2026-08-09 19:01:16 on dist-test-slave-266d"
server_key: "c9d2ced9210a38b92dda86613dfde10c"
server_key_iv: "1e4c2f7ece04f4326b96c4338266fea5"
server_key_version: "encryptionkey@0"
I20260809 19:01:16.824720 14535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:16.839715 14535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:16.840538 14535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:16.840850 14535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:16.841904 14535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:16.843379 14535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:16.843487 14535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:16.843617 14535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:16.843703 14535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:16.875552 14535 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:33295
I20260809 19:01:16.875589 14722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:33295 every 8 connection(s)
I20260809 19:01:16.876945 14535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:01:16.877300 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 14535
I20260809 19:01:16.877450 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 19:01:16.878046 17139 external_mini_cluster.cc:1428] Setting key e3f8e4f30b20129307f0ac4b17d7cb26
I20260809 19:01:16.881229 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35713
--builtin_ntp_servers=127.16.188.212:37749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:01:16.891578 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:16.879810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:53237 (local address 127.16.188.254:35713)
0809 19:01:16.882041 (+ 2231us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:16.882046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:16.882064 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:01:16.884377 (+ 2313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:16.884381 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:16.884449 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:16.884542 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:16.885936 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:16.886634 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:16.888771 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:16.889224 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:16.889321 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:16.890852 (+ 1531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:16.890857 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:16.890860 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:16.890878 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:16.890916 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:16.890928 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:16.890994 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:16.891235 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 19:01:16.891313 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2130,"thread_start_us":2010,"threads_started":1}
I20260809 19:01:16.892894 14730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:16.880384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35713 (local address 127.16.188.193:53237)
0809 19:01:16.881783 (+ 1399us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:16.881834 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:16.884068 (+ 2234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:16.884812 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:16.884823 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:16.884932 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:16.885758 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:16.885785 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:16.886795 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:16.886801 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:16.888604 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:16.888621 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:16.889452 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:16.889460 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:16.889750 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:16.890502 (+ 752us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:16.890506 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:16.890569 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:16.890666 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:16.891019 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:16.891030 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:16.891039 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 19:01:16.891237 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 19:01:16.891609 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":365,"threads_started":1}
I20260809 19:01:16.894425 14723 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35713
I20260809 19:01:16.894788 14723 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:16.895773 14723 heartbeater.cc:511] Master 127.16.188.254:35713 requested a full tablet report, sending...
I20260809 19:01:16.898125 14446 ts_manager.cc:194] Registered new tserver with Master: aedc74fa19214e32912bc17e4a274ff8 (127.16.188.193:33295)
I20260809 19:01:16.899713 14446 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.193:53237
W20260809 19:01:17.209684 14732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:17.209957 14732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:17.210093 14732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:17.217411 14732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:17.217512 14732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:17.217659 14732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:01:17.226364 14732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:17.227640 14732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:17.229423 14732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:17.241680 14743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:17.241730 14745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:17.241751 14742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:17.242439 14732 server_base.cc:1034] running on GCE node
I20260809 19:01:17.243005 14732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:17.243849 14732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:17.245040 14732 hybrid_clock.cc:648] HybridClock initialized: now 1786302077244990 us; error 39 us; skew 500 ppm
I20260809 19:01:17.245342 14732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:17.247324 14732 webserver.cc:460] Webserver started at http://127.16.188.194:38367/ using document root <none> and password file <none>
I20260809 19:01:17.247942 14732 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:17.248039 14732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:17.248323 14732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:17.251017 14732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "edee48e9590a4fed94330048d8c91c17"
format_stamp: "Formatted at 2026-08-09 19:01:17 on dist-test-slave-266d"
server_key: "3b97b9f28e1235cf42b999f105d20207"
server_key_iv: "312a4bbc9ebae770776c40340e5b4fb7"
server_key_version: "encryptionkey@0"
I20260809 19:01:17.251744 14732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "edee48e9590a4fed94330048d8c91c17"
format_stamp: "Formatted at 2026-08-09 19:01:17 on dist-test-slave-266d"
server_key: "3b97b9f28e1235cf42b999f105d20207"
server_key_iv: "312a4bbc9ebae770776c40340e5b4fb7"
server_key_version: "encryptionkey@0"
I20260809 19:01:17.256484 14732 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 19:01:17.259828 14754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:17.261034 14732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:01:17.261229 14732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "edee48e9590a4fed94330048d8c91c17"
format_stamp: "Formatted at 2026-08-09 19:01:17 on dist-test-slave-266d"
server_key: "3b97b9f28e1235cf42b999f105d20207"
server_key_iv: "312a4bbc9ebae770776c40340e5b4fb7"
server_key_version: "encryptionkey@0"
I20260809 19:01:17.261431 14732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:17.299006 14732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:17.299774 14732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:17.300050 14732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:17.300994 14732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:17.302415 14732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:17.302507 14732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:17.302605 14732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:17.302675 14732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:17.332922 14732 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:43031
I20260809 19:01:17.332943 14931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:43031 every 8 connection(s)
I20260809 19:01:17.334436 14732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:01:17.342278 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 14732
I20260809 19:01:17.342470 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 19:01:17.343052 17139 external_mini_cluster.cc:1428] Setting key 11bd93d8a4381fe56893b3db2ff8282d
I20260809 19:01:17.346119 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35713
--builtin_ntp_servers=127.16.188.212:37749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:01:17.346724 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.336970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:47493 (local address 127.16.188.254:35713)
0809 19:01:17.337181 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.337185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.338548 (+ 1363us) server_negotiation.cc:407] Connection header received
0809 19:01:17.340244 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.340248 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.340317 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.340400 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:17.341506 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.342187 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.344142 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.344528 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.344617 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.345983 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:17.345988 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:17.345991 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:17.346007 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:17.346040 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:17.346051 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:17.346116 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.346431 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.346509 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:01:17.347959 14934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.337474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35713 (local address 127.16.188.194:47493)
0809 19:01:17.338392 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:17.338428 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:17.340013 (+ 1585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:17.340604 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:17.340612 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:17.340702 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:17.341361 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.341386 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.342346 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.342351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.344017 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.344029 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.344744 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.344753 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.344945 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.345648 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:17.345652 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:17.345699 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:17.345803 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:17.346147 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:17.346157 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:17.346165 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:01:17.346386 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 19:01:17.346735 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":284,"threads_started":1}
I20260809 19:01:17.349277 14932 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35713
I20260809 19:01:17.349581 14932 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:17.350410 14932 heartbeater.cc:511] Master 127.16.188.254:35713 requested a full tablet report, sending...
I20260809 19:01:17.351835 14446 ts_manager.cc:194] Registered new tserver with Master: edee48e9590a4fed94330048d8c91c17 (127.16.188.194:43031)
I20260809 19:01:17.352842 14446 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.194:47493
W20260809 19:01:17.669293 14936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:17.669557 14936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:17.669660 14936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:17.676600 14936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:17.676690 14936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:17.676831 14936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:01:17.685456 14936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:35713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:17.686738 14936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:17.688823 14936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:17.701809 14945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:17.701825 14944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:17.701788 14947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:17.702623 14936 server_base.cc:1034] running on GCE node
I20260809 19:01:17.703197 14936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:17.704079 14936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:17.705271 14936 hybrid_clock.cc:648] HybridClock initialized: now 1786302077705221 us; error 39 us; skew 500 ppm
I20260809 19:01:17.705550 14936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:17.707676 14936 webserver.cc:460] Webserver started at http://127.16.188.195:44485/ using document root <none> and password file <none>
I20260809 19:01:17.708308 14936 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:17.708407 14936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:17.708712 14936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:17.711483 14936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "1d678575074d4dd1b8664b352f2c2345"
format_stamp: "Formatted at 2026-08-09 19:01:17 on dist-test-slave-266d"
server_key: "dc829e05fa1dfc8f0fe40f340e29548b"
server_key_iv: "e121935566f4b8ff2a259bec1e803ebe"
server_key_version: "encryptionkey@0"
I20260809 19:01:17.712229 14936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "1d678575074d4dd1b8664b352f2c2345"
format_stamp: "Formatted at 2026-08-09 19:01:17 on dist-test-slave-266d"
server_key: "dc829e05fa1dfc8f0fe40f340e29548b"
server_key_iv: "e121935566f4b8ff2a259bec1e803ebe"
server_key_version: "encryptionkey@0"
I20260809 19:01:17.717133 14936 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:01:17.720440 14959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:17.721692 14936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:01:17.721845 14936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "1d678575074d4dd1b8664b352f2c2345"
format_stamp: "Formatted at 2026-08-09 19:01:17 on dist-test-slave-266d"
server_key: "dc829e05fa1dfc8f0fe40f340e29548b"
server_key_iv: "e121935566f4b8ff2a259bec1e803ebe"
server_key_version: "encryptionkey@0"
I20260809 19:01:17.722029 14936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:17.747149 14936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:17.748010 14936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:17.748303 14936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:17.749320 14936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:17.750814 14936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:17.750910 14936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:17.751015 14936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:17.751088 14936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:17.781082 14936 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:38585
I20260809 19:01:17.781176 15137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:38585 every 8 connection(s)
I20260809 19:01:17.782374 14936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:01:17.785215 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 14936
I20260809 19:01:17.785369 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 19:01:17.785844 17139 external_mini_cluster.cc:1428] Setting key f6a8b42fd037d6a525ce251e24037ea1
I20260809 19:01:17.794497 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.784824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:39257 (local address 127.16.188.254:35713)
0809 19:01:17.785048 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.785054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.786614 (+ 1560us) server_negotiation.cc:407] Connection header received
0809 19:01:17.788721 (+ 2107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.788726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.788802 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.788883 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:17.789987 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.790737 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.792179 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.792556 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.792645 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.793840 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:17.793845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:17.793848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:17.793864 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:17.793893 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:17.793904 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:17.793968 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.794148 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.794221 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:01:17.795614 15143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.785415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:35713 (local address 127.16.188.195:39257)
0809 19:01:17.786455 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:17.786492 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:17.788427 (+ 1935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:17.789137 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:17.789151 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:17.789260 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:17.789855 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.789873 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.790871 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.790875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.792071 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.792085 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.792724 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.792728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.792916 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.793571 (+ 655us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:17.793581 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:17.793621 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:17.793699 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:17.793972 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:17.793978 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:17.793983 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 19:01:17.794119 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 19:01:17.794397 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":281,"threads_started":1}
I20260809 19:01:17.796828 15140 heartbeater.cc:347] Connected to a master server at 127.16.188.254:35713
I20260809 19:01:17.797132 15140 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:17.797842 15140 heartbeater.cc:511] Master 127.16.188.254:35713 requested a full tablet report, sending...
I20260809 19:01:17.799158 14446 ts_manager.cc:194] Registered new tserver with Master: 1d678575074d4dd1b8664b352f2c2345 (127.16.188.195:38585)
I20260809 19:01:17.799997 14446 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.195:39257
I20260809 19:01:17.801025 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:01:17.810281 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.804797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52174 (local address 127.16.188.254:35713)
0809 19:01:17.804983 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.804990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.805402 (+ 412us) server_negotiation.cc:407] Connection header received
0809 19:01:17.805528 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.805531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.805621 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.805697 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:17.806109 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.806798 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.808082 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.808480 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.808575 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.809611 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:17.809616 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:17.809620 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:17.809635 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:17.809666 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:17.809679 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:17.809789 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.809916 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.809979 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:01:17.813760 14445 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:01:17.820428 14445 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:01:17.853526 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.832487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59638 (local address 127.16.188.195:38585)
0809 19:01:17.842347 (+ 9860us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.842369 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.844129 (+ 1760us) server_negotiation.cc:407] Connection header received
0809 19:01:17.844223 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.844229 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.844405 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.844592 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:17.845788 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.847358 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.850570 (+ 3212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.852035 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.852315 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.852571 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.852859 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.853039 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9663,"thread_start_us":9515,"threads_started":1}
I20260809 19:01:17.853747 15162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.831992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:43031 (local address 127.0.0.1:52076)
0809 19:01:17.843434 (+ 11442us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:17.843905 (+ 471us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:17.844009 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:17.844874 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:17.844882 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:17.844943 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:17.846109 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.846124 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.848822 (+ 2698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.848829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.850988 (+ 2159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.851004 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.852735 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.852742 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.852951 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.852983 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 19:01:17.853050 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 19:01:17.853341 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10855,"mutex_wait_us":3,"thread_start_us":11783,"threads_started":1}
I20260809 19:01:17.853760 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.832370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52076 (local address 127.16.188.194:43031)
0809 19:01:17.843204 (+ 10834us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.843224 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.844050 (+ 826us) server_negotiation.cc:407] Connection header received
0809 19:01:17.844162 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.844171 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.844413 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.844592 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:17.846327 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.848612 (+ 2285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.851219 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.852329 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.852512 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.852773 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.853236 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.853449 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10656,"thread_start_us":10101,"threads_started":1}
I20260809 19:01:17.854748 15160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.832275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:38585 (local address 127.0.0.1:59638)
0809 19:01:17.843434 (+ 11159us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:17.843516 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:17.843720 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:17.844876 (+ 1156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:17.844883 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:17.844944 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:17.845501 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.845520 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.847475 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.847480 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.850338 (+ 2858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.850359 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.852274 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.852283 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.852513 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.852585 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 19:01:17.854192 (+ 1607us) client_negotiation.cc:240] Negotiation successful
0809 19:01:17.854355 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10666,"spinlock_wait_cycles":20608,"thread_start_us":10414,"threads_started":1}
I20260809 19:01:17.856810 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.845851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40042)
0809 19:01:17.846628 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:17.846647 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:17.846766 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:17.848429 (+ 1663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:17.848433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:17.848458 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:17.848825 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.848839 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.850735 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.850740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.852871 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.852886 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.855889 (+ 3003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.855897 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.856104 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.856144 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 19:01:17.856259 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 19:01:17.856427 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"mutex_wait_us":66,"thread_start_us":502,"threads_started":1}
I20260809 19:01:17.856853 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.843845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40042 (local address 127.16.188.193:33295)
0809 19:01:17.847554 (+ 3709us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.847561 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.847590 (+ 29us) server_negotiation.cc:407] Connection header received
0809 19:01:17.847695 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.847702 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.847996 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.848201 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:17.849044 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.850572 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.853075 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.855618 (+ 2543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.855783 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.855994 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.856339 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.856503 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1752,"thread_start_us":1640,"threads_started":1}
I20260809 19:01:17.858657 15030 tablet_service.cc:1467] Processing CreateTablet for tablet 95eece9ef6dd4940a7985ac333f0c5ff (DEFAULT_TABLE table=test-table [id=cc3c9e70d5bc4852b640e76bc0987efd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:17.860203 15030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95eece9ef6dd4940a7985ac333f0c5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:17.860297 14630 tablet_service.cc:1467] Processing CreateTablet for tablet 95eece9ef6dd4940a7985ac333f0c5ff (DEFAULT_TABLE table=test-table [id=cc3c9e70d5bc4852b640e76bc0987efd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:17.861441 14630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95eece9ef6dd4940a7985ac333f0c5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:17.858062 14830 tablet_service.cc:1467] Processing CreateTablet for tablet 95eece9ef6dd4940a7985ac333f0c5ff (DEFAULT_TABLE table=test-table [id=cc3c9e70d5bc4852b640e76bc0987efd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:17.864938 14830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95eece9ef6dd4940a7985ac333f0c5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:17.873039 15169 tablet_bootstrap.cc:492] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: Bootstrap starting.
I20260809 19:01:17.877501 15169 tablet_bootstrap.cc:654] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:17.879096 15169 log.cc:824] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:17.882990 15170 tablet_bootstrap.cc:492] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8: Bootstrap starting.
I20260809 19:01:17.887292 15170 tablet_bootstrap.cc:654] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:17.888113 15171 tablet_bootstrap.cc:492] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: Bootstrap starting.
I20260809 19:01:17.889528 15170 log.cc:824] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:17.892560 15171 tablet_bootstrap.cc:654] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:17.894845 15171 log.cc:824] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:17.895555 15170 tablet_bootstrap.cc:492] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8: No bootstrap required, opened a new log
I20260809 19:01:17.895612 15169 tablet_bootstrap.cc:492] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: No bootstrap required, opened a new log
I20260809 19:01:17.895867 15170 ts_tablet_manager.cc:1397] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260809 19:01:17.895911 15169 ts_tablet_manager.cc:1397] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.014s
I20260809 19:01:17.898079 15171 tablet_bootstrap.cc:492] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: No bootstrap required, opened a new log
I20260809 19:01:17.898336 15171 ts_tablet_manager.cc:1397] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.001s
I20260809 19:01:17.902633 14723 heartbeater.cc:503] Master 127.16.188.254:35713 was elected leader, sending a full tablet report...
I20260809 19:01:17.903975 15169 raft_consensus.cc:348] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.904415 15169 raft_consensus.cc:374] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:17.904506 15169 raft_consensus.cc:729] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d678575074d4dd1b8664b352f2c2345, State: Initialized, Role: FOLLOWER
I20260809 19:01:17.905208 15169 consensus_queue.cc:260] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.906766 15170 raft_consensus.cc:348] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.907194 15170 raft_consensus.cc:374] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:17.907297 15170 raft_consensus.cc:729] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aedc74fa19214e32912bc17e4a274ff8, State: Initialized, Role: FOLLOWER
I20260809 19:01:17.907971 15170 consensus_queue.cc:260] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.908573 15140 heartbeater.cc:503] Master 127.16.188.254:35713 was elected leader, sending a full tablet report...
I20260809 19:01:17.908871 15171 raft_consensus.cc:348] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.909354 15171 raft_consensus.cc:374] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:17.909457 15171 raft_consensus.cc:729] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edee48e9590a4fed94330048d8c91c17, State: Initialized, Role: FOLLOWER
I20260809 19:01:17.910053 15171 consensus_queue.cc:260] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.910478 15169 ts_tablet_manager.cc:1428] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 19:01:17.910957 15170 ts_tablet_manager.cc:1428] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
I20260809 19:01:17.911413 14932 heartbeater.cc:503] Master 127.16.188.254:35713 was elected leader, sending a full tablet report...
I20260809 19:01:17.912079 15171 ts_tablet_manager.cc:1428] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: Time spent starting tablet: real 0.014s user 0.011s sys 0.003s
I20260809 19:01:17.915694 15180 raft_consensus.cc:482] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:01:17.915956 15180 raft_consensus.cc:504] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.917631 15180 leader_election.cc:288] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edee48e9590a4fed94330048d8c91c17 (127.16.188.194:43031), aedc74fa19214e32912bc17e4a274ff8 (127.16.188.193:33295)
I20260809 19:01:17.923416 15143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.917814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:43031 (local address 127.16.188.195:60693)
0809 19:01:17.918019 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:17.918041 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:17.918162 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:17.918567 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:17.918573 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:17.918611 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:17.918838 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.918860 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.920016 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.920021 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.921815 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.921833 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.922838 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.922842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.922986 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.923013 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 19:01:17.923094 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 19:01:17.923193 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":22}
I20260809 19:01:17.923507 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.918093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:60693 (local address 127.16.188.194:43031)
0809 19:01:17.918287 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.918294 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.918312 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:01:17.918368 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.918371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.918422 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.918503 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:17.919023 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.919869 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.921969 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.922696 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.922839 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.922907 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.923144 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.923268 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 19:01:17.924582 15185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.917869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.16.188.195:42731)
0809 19:01:17.919120 (+ 1251us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:17.919135 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:17.919230 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:17.919524 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:17.919526 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:17.919544 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:17.919858 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.919866 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.920795 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.920802 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.922579 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:17.922593 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.923946 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.923963 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:17.924135 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.924160 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 19:01:17.924239 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 19:01:17.924323 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1120,"mutex_wait_us":24,"thread_start_us":867,"threads_started":1}
I20260809 19:01:17.924631 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.918201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:42731 (local address 127.16.188.193:33295)
0809 19:01:17.918389 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.918396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.919213 (+ 817us) server_negotiation.cc:407] Connection header received
0809 19:01:17.919331 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.919336 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.919416 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.919505 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:17.920004 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.920644 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.922764 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.923792 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.923902 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.923945 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.924283 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.924399 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:01:17.924527 14865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95eece9ef6dd4940a7985ac333f0c5ff" candidate_uuid: "1d678575074d4dd1b8664b352f2c2345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edee48e9590a4fed94330048d8c91c17" is_pre_election: true
I20260809 19:01:17.925082 14865 raft_consensus.cc:2454] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d678575074d4dd1b8664b352f2c2345 in term 0.
I20260809 19:01:17.925777 14964 leader_election.cc:302] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d678575074d4dd1b8664b352f2c2345, edee48e9590a4fed94330048d8c91c17; no voters:
I20260809 19:01:17.925673 14661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95eece9ef6dd4940a7985ac333f0c5ff" candidate_uuid: "1d678575074d4dd1b8664b352f2c2345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedc74fa19214e32912bc17e4a274ff8" is_pre_election: true
I20260809 19:01:17.926189 15180 raft_consensus.cc:2781] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:01:17.926326 15180 raft_consensus.cc:482] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:01:17.926260 14661 raft_consensus.cc:2454] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d678575074d4dd1b8664b352f2c2345 in term 0.
I20260809 19:01:17.926412 15180 raft_consensus.cc:3037] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:17.928781 15180 raft_consensus.cc:504] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.929412 15180 leader_election.cc:288] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [CANDIDATE]: Term 1 election: Requested vote from peers edee48e9590a4fed94330048d8c91c17 (127.16.188.194:43031), aedc74fa19214e32912bc17e4a274ff8 (127.16.188.193:33295)
I20260809 19:01:17.929795 14865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95eece9ef6dd4940a7985ac333f0c5ff" candidate_uuid: "1d678575074d4dd1b8664b352f2c2345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edee48e9590a4fed94330048d8c91c17"
I20260809 19:01:17.929993 14865 raft_consensus.cc:3037] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:17.930230 14661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95eece9ef6dd4940a7985ac333f0c5ff" candidate_uuid: "1d678575074d4dd1b8664b352f2c2345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedc74fa19214e32912bc17e4a274ff8"
I20260809 19:01:17.930403 14661 raft_consensus.cc:3037] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:17.932212 14865 raft_consensus.cc:2454] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d678575074d4dd1b8664b352f2c2345 in term 1.
I20260809 19:01:17.932554 14964 leader_election.cc:302] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d678575074d4dd1b8664b352f2c2345, edee48e9590a4fed94330048d8c91c17; no voters:
I20260809 19:01:17.932760 14661 raft_consensus.cc:2454] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d678575074d4dd1b8664b352f2c2345 in term 1.
I20260809 19:01:17.932793 15180 raft_consensus.cc:2781] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:17.933272 15180 raft_consensus.cc:686] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 1 LEADER]: Becoming Leader. State: Replica: 1d678575074d4dd1b8664b352f2c2345, State: Running, Role: LEADER
I20260809 19:01:17.933693 15180 consensus_queue.cc:237] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } }
I20260809 19:01:17.938138 14443 catalog_manager.cc:5495] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d678575074d4dd1b8664b352f2c2345 (127.16.188.195). New cstate: current_term: 1 leader_uuid: "1d678575074d4dd1b8664b352f2c2345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d678575074d4dd1b8664b352f2c2345" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260809 19:01:17.961366 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:17.955761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59646 (local address 127.16.188.195:38585)
0809 19:01:17.955958 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:17.955964 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:17.956054 (+ 90us) server_negotiation.cc:407] Connection header received
0809 19:01:17.956252 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:17.956256 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:17.956366 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:17.956492 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:17.956964 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.957769 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.959164 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:17.959587 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:17.959697 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:17.960291 (+ 594us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:17.960782 (+ 491us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:17.960937 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:17.961077 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 19:01:17.961156 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:01:17.969555 14865 raft_consensus.cc:1261] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 1 FOLLOWER]: Refusing update from remote peer 1d678575074d4dd1b8664b352f2c2345: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:17.969555 14661 raft_consensus.cc:1261] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 1 FOLLOWER]: Refusing update from remote peer 1d678575074d4dd1b8664b352f2c2345: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:17.970584 15180 consensus_queue.cc:1035] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aedc74fa19214e32912bc17e4a274ff8" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:17.970889 15187 consensus_queue.cc:1035] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edee48e9590a4fed94330048d8c91c17" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:17.980727 15193 mvcc.cc:205] Tried to move back new op lower bound from 7316693311352635392 to 7316693311219818496. Current Snapshot: MvccSnapshot[applied={T|T < 7316693311352635392}]
I20260809 19:01:17.990257 15195 mvcc.cc:205] Tried to move back new op lower bound from 7316693311352635392 to 7316693311219818496. Current Snapshot: MvccSnapshot[applied={T|T < 7316693311352635392}]
I20260809 19:01:17.997839 14445 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:17.998132 14445 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:18.002784 14445 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 303b3a70784841fa9fd5e666741a4434: Sending DeleteTablet for 3 replicas of tablet 95eece9ef6dd4940a7985ac333f0c5ff
I20260809 19:01:18.003852 14830 tablet_service.cc:1514] Processing DeleteTablet for tablet 95eece9ef6dd4940a7985ac333f0c5ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:17 UTC) from {username='slave'} at 127.0.0.1:52076
I20260809 19:01:18.004434 14828 tablet_service.cc:1514] Processing DeleteTablet for tablet 95eece9ef6dd4940a7985ac333f0c5ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:17 UTC) from {username='slave'} at 127.0.0.1:52076
I20260809 19:01:18.004508 15030 tablet_service.cc:1514] Processing DeleteTablet for tablet 95eece9ef6dd4940a7985ac333f0c5ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:17 UTC) from {username='slave'} at 127.0.0.1:59638
I20260809 19:01:18.004912 14630 tablet_service.cc:1514] Processing DeleteTablet for tablet 95eece9ef6dd4940a7985ac333f0c5ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:17 UTC) from {username='slave'} at 127.0.0.1:40042
I20260809 19:01:18.006369 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 14535
I20260809 19:01:18.037509 15207 tablet_replica.cc:330] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: stopping tablet replica
I20260809 19:01:18.038017 15207 raft_consensus.cc:2229] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:01:18.038849 15207 raft_consensus.cc:2258] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:18.041829 15206 tablet_replica.cc:330] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: stopping tablet replica
I20260809 19:01:18.042193 15206 raft_consensus.cc:2229] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:18.042621 15206 raft_consensus.cc:2258] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:18.043378 15211 tablet_replica.cc:330] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8: stopping tablet replica
I20260809 19:01:18.043798 15211 raft_consensus.cc:2229] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:18.044317 15211 raft_consensus.cc:2258] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:18.044593 15207 ts_tablet_manager.cc:1905] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:18.045030 15206 ts_tablet_manager.cc:1905] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:18.045327 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.007394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40058 (local address 127.16.188.193:33295)
0809 19:01:18.007568 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:18.007574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:18.032365 (+ 24791us) server_negotiation.cc:407] Connection header received
0809 19:01:18.032929 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:18.032936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:18.033064 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:18.033200 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:18.033919 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:18.035066 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:18.039224 (+ 4158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:18.039926 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:18.040034 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:18.043265 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:18.043278 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:18.043295 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:18.044069 (+ 774us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:18.044131 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:18.044156 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:18.044268 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:18.044847 (+ 579us) server_negotiation.cc:299] Negotiation successful
0809 19:01:18.044962 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:01:18.046432 14718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:18.052834 15206 ts_tablet_manager.cc:1918] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:18.053042 15206 log.cc:1196] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/95eece9ef6dd4940a7985ac333f0c5ff
I20260809 19:01:18.053673 15206 ts_tablet_manager.cc:1939] T 95eece9ef6dd4940a7985ac333f0c5ff P edee48e9590a4fed94330048d8c91c17: Deleting consensus metadata
I20260809 19:01:18.054505 15207 ts_tablet_manager.cc:1918] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:18.054678 15207 log.cc:1196] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/95eece9ef6dd4940a7985ac333f0c5ff
I20260809 19:01:18.055215 15207 ts_tablet_manager.cc:1939] T 95eece9ef6dd4940a7985ac333f0c5ff P 1d678575074d4dd1b8664b352f2c2345: Deleting consensus metadata
I20260809 19:01:18.056277 14423 catalog_manager.cc:4841] TS edee48e9590a4fed94330048d8c91c17 (127.16.188.194:43031): tablet 95eece9ef6dd4940a7985ac333f0c5ff (table test-table [id=cc3c9e70d5bc4852b640e76bc0987efd]) successfully deleted
I20260809 19:01:18.056901 14422 catalog_manager.cc:4841] TS 1d678575074d4dd1b8664b352f2c2345 (127.16.188.195:38585): tablet 95eece9ef6dd4940a7985ac333f0c5ff (table test-table [id=cc3c9e70d5bc4852b640e76bc0987efd]) successfully deleted
W20260809 19:01:18.057469 14423 catalog_manager.cc:4808] TS edee48e9590a4fed94330048d8c91c17 (127.16.188.194:43031): delete failed for tablet 95eece9ef6dd4940a7985ac333f0c5ff because the tablet was not found. No further retry: Not found: Tablet not found: 95eece9ef6dd4940a7985ac333f0c5ff
I20260809 19:01:18.047187 15211 ts_tablet_manager.cc:1905] T 95eece9ef6dd4940a7985ac333f0c5ff P aedc74fa19214e32912bc17e4a274ff8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:18.142715 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 14535
W20260809 19:01:18.169576 14422 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.188.193:33295 (error 108)
I20260809 19:01:18.170233 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 14732
I20260809 19:01:18.171618 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.171053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40074)
0809 19:01:18.171316 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:18.171422 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
W20260809 19:01:18.171886 14422 catalog_manager.cc:4584] TS aedc74fa19214e32912bc17e4a274ff8 (127.16.188.193:33295): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 95eece9ef6dd4940a7985ac333f0c5ff: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
I20260809 19:01:18.181731 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.171055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52090 (local address 127.16.188.194:43031)
0809 19:01:18.171241 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:18.171248 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:18.171420 (+ 172us) server_negotiation.cc:407] Connection header received
0809 19:01:18.171627 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:18.171633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:18.171771 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:18.171886 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:18.172553 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:18.173480 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:18.175404 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:18.175803 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:18.175892 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:18.180054 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:18.180064 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:18.180079 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:18.180747 (+ 668us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:18.180798 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:18.180820 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:18.180911 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:18.181193 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 19:01:18.181295 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:01:18.182344 14925 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:18.225734 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.225037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40078)
0809 19:01:18.225348 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:18.225495 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260809 19:01:18.226986 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.226571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40080)
0809 19:01:18.226743 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:18.226846 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 19:01:18.270112 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 14732
I20260809 19:01:18.287623 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.287146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40092)
0809 19:01:18.287363 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:18.287450 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 19:01:18.288672 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.288330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40096)
0809 19:01:18.288480 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:18.288553 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 19:01:18.303088 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 14936
I20260809 19:01:18.311218 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.303842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59658 (local address 127.16.188.195:38585)
0809 19:01:18.304011 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:18.304015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:18.304094 (+ 79us) server_negotiation.cc:407] Connection header received
0809 19:01:18.304293 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:18.304297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:18.304395 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:18.304479 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:18.304971 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:18.305909 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:18.307844 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:18.308295 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:18.308407 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:18.309705 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:18.309714 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:18.309731 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:18.310393 (+ 662us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:18.310448 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:18.310491 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:18.310620 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:18.310775 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 19:01:18.310857 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 19:01:18.311904 15132 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:18.369189 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.368656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40110)
0809 19:01:18.368875 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:18.368974 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 19:01:18.370352 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.369953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40112)
0809 19:01:18.370155 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:18.370230 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 19:01:18.437024 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 14936
I20260809 19:01:18.459836 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 14396
I20260809 19:01:18.460937 14491 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:18.566992 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:18.566301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:33295 (local address 127.0.0.1:40118)
0809 19:01:18.566669 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:18.566792 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.193:33295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260809 19:01:18.567044 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 14396
2026-08-09T19:01:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2775 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:18 dist-test-slave-266d krb5kdc[15226](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:18 dist-test-slave-266d krb5kdc[15226](info): set up 2 sockets
Aug 09 19:01:18 dist-test-slave-266d krb5kdc[15226](info): commencing operation
krb5kdc: starting...
W20260809 19:01:19.809643 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:19 dist-test-slave-266d krb5kdc[15226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:01:20.087553 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:42717
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:42717
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:20.424845 15248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:20.425163 15248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:20.425297 15248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:20.432343 15248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:20.432456 15248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:20.432538 15248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:20.432617 15248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:20.432677 15248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:20.442243 15248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:42717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:42717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:20.443524 15248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:20.444816 15248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:20.456110 15254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:20.456161 15256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:20.456296 15259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:20.456988 15248 server_base.cc:1034] running on GCE node
I20260809 19:01:20.457722 15248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:20.459035 15248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:20.460220 15248 hybrid_clock.cc:648] HybridClock initialized: now 1786302080460169 us; error 43 us; skew 500 ppm
I20260809 19:01:20.460541 15248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:20 dist-test-slave-266d krb5kdc[15226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302080, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:20.463485 15248 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:01:20.464828 15248 webserver.cc:460] Webserver started at http://127.16.188.254:39711/ using document root <none> and password file <none>
I20260809 19:01:20.465516 15248 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:20.465636 15248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:20.465925 15248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:20.468729 15248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619"
format_stamp: "Formatted at 2026-08-09 19:01:20 on dist-test-slave-266d"
server_key: "7530b21b6c054e7b24ce200bcbd54ed0"
server_key_iv: "3986498dfba7acde11d6fe35416e24de"
server_key_version: "encryptionkey@0"
I20260809 19:01:20.469460 15248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619"
format_stamp: "Formatted at 2026-08-09 19:01:20 on dist-test-slave-266d"
server_key: "7530b21b6c054e7b24ce200bcbd54ed0"
server_key_iv: "3986498dfba7acde11d6fe35416e24de"
server_key_version: "encryptionkey@0"
I20260809 19:01:20.474277 15248 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 19:01:20.477471 15276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:20.478610 15248 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 19:01:20.478758 15248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619"
format_stamp: "Formatted at 2026-08-09 19:01:20 on dist-test-slave-266d"
server_key: "7530b21b6c054e7b24ce200bcbd54ed0"
server_key_iv: "3986498dfba7acde11d6fe35416e24de"
server_key_version: "encryptionkey@0"
I20260809 19:01:20.478936 15248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:20.496219 15248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:20.499734 15248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:20.499984 15248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:20.516019 15248 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:42717
I20260809 19:01:20.516067 15356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:42717 every 8 connection(s)
I20260809 19:01:20.517270 15248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:20.520700 15357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:20.523416 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 15248
I20260809 19:01:20.523581 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:20.524022 17139 external_mini_cluster.cc:1428] Setting key 5f1a9831462f64510ee40a21e1ff64fa
I20260809 19:01:20.532892 15357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619: Bootstrap starting.
I20260809 19:01:20.536265 15357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:20.537261 15357 log.cc:824] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619: Log is configured to *not* fsync() on all Append() calls
Aug 09 19:01:20 dist-test-slave-266d krb5kdc[15226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:20.540154 15357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619: No bootstrap required, opened a new log
I20260809 19:01:20.546411 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:20.525745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.16.188.254:42717)
0809 19:01:20.526538 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:20.526552 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:20.526598 (+ 46us) server_negotiation.cc:407] Connection header received
0809 19:01:20.528836 (+ 2238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:20.528863 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:20.529377 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:20.529818 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:20.531120 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:20.533045 (+ 1925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:20.534303 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:20.535287 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:20.535462 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:20.539494 (+ 4032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:20.539501 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:20.539515 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:20.539549 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:20.542503 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:20.543308 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:20.543314 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:20.543320 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:20.543475 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:20.543866 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:20.543869 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:20.543871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:20.544356 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:20.544572 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:20.545032 (+ 460us) server_negotiation.cc:299] Negotiation successful
0809 19:01:20.545407 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":333,"threads_started":1}
I20260809 19:01:20.548894 15357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42717 } }
I20260809 19:01:20.549364 15357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:20.549471 15357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b7a675ac0d447c3aa5d0e2dc1cf6619, State: Initialized, Role: FOLLOWER
I20260809 19:01:20.549957 15357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42717 } }
I20260809 19:01:20.550166 15357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:20.550266 15357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:20.550375 15357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:20.552362 15357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42717 } }
I20260809 19:01:20.552788 15357 leader_election.cc:302] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b7a675ac0d447c3aa5d0e2dc1cf6619; no voters:
I20260809 19:01:20.553306 15357 leader_election.cc:288] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:20.553421 15366 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:20.554049 15366 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [term 1 LEADER]: Becoming Leader. State: Replica: 0b7a675ac0d447c3aa5d0e2dc1cf6619, State: Running, Role: LEADER
I20260809 19:01:20.554543 15366 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42717 } }
I20260809 19:01:20.555297 15357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:20.557390 15369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b7a675ac0d447c3aa5d0e2dc1cf6619. Latest consensus state: current_term: 1 leader_uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42717 } } }
I20260809 19:01:20.557493 15368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b7a675ac0d447c3aa5d0e2dc1cf6619" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42717 } } }
I20260809 19:01:20.557757 15369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:20.557832 15368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:20.559173 15373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:20.564843 15373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:20.574373 15373 catalog_manager.cc:1347] Generated new cluster ID: 8fdc18f7d3f34008a43ad8656bfc3878
I20260809 19:01:20.574486 15373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:20.598544 15373 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:20.599790 15373 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:20.607175 15373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619: Generated new TSK 0
I20260809 19:01:20.607877 15373 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.188.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
Entry for principal kudu/127.16.188.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab.
I20260809 19:01:20.678540 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:42717
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:21.007340 15395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:21.007596 15395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:21.007722 15395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:21.014658 15395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:21.014768 15395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:21.014914 15395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:01:21.024565 15395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.193.keytab
--principal=kudu/127.16.188.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:42717
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:21.025790 15395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:21.027055 15395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:21.038914 15404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:21.038883 15405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:21.038898 15407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:21.039875 15395 server_base.cc:1034] running on GCE node
I20260809 19:01:21.040450 15395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:21.041324 15395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:21.042517 15395 hybrid_clock.cc:648] HybridClock initialized: now 1786302081042467 us; error 41 us; skew 500 ppm
I20260809 19:01:21.042790 15395 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:21 dist-test-slave-266d krb5kdc[15226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302081, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:21.045800 15395 init.cc:377] Logged in from keytab as kudu/127.16.188.193@KRBTEST.COM (short username kudu)
I20260809 19:01:21.047349 15395 webserver.cc:460] Webserver started at http://127.16.188.193:34921/ using document root <none> and password file <none>
I20260809 19:01:21.048070 15395 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:21.048171 15395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:21.048429 15395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:21.051129 15395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "f701fbe17eaa4a70b4d6d935ee36919a"
format_stamp: "Formatted at 2026-08-09 19:01:21 on dist-test-slave-266d"
server_key: "1bdb1ec8016c368fb33502b05c5acdbf"
server_key_iv: "eae69cd19d83ac4d3403b3ab1069c5ce"
server_key_version: "encryptionkey@0"
I20260809 19:01:21.051935 15395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "f701fbe17eaa4a70b4d6d935ee36919a"
format_stamp: "Formatted at 2026-08-09 19:01:21 on dist-test-slave-266d"
server_key: "1bdb1ec8016c368fb33502b05c5acdbf"
server_key_iv: "eae69cd19d83ac4d3403b3ab1069c5ce"
server_key_version: "encryptionkey@0"
I20260809 19:01:21.056754 15395 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:01:21.060035 15417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:21.061367 15395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:21.061520 15395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "f701fbe17eaa4a70b4d6d935ee36919a"
format_stamp: "Formatted at 2026-08-09 19:01:21 on dist-test-slave-266d"
server_key: "1bdb1ec8016c368fb33502b05c5acdbf"
server_key_iv: "eae69cd19d83ac4d3403b3ab1069c5ce"
server_key_version: "encryptionkey@0"
I20260809 19:01:21.061704 15395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:21.087775 15395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:21.091847 15395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:21.092110 15395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:21.093008 15395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:21.094306 15395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:21.094388 15395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:21.094506 15395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:21.094558 15395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:21.123616 15395 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:46709
I20260809 19:01:21.123663 15588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:46709 every 8 connection(s)
I20260809 19:01:21.124821 15395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:01:21.126761 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 15395
I20260809 19:01:21.126924 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 19:01:21.127465 17139 external_mini_cluster.cc:1428] Setting key 31f134e22b461ca5991f289a7670e795
Aug 09 19:01:21 dist-test-slave-266d krb5kdc[15226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302081, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.193@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:21.144160 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:21.127347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:39343 (local address 127.16.188.254:42717)
0809 19:01:21.127901 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:21.127906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:21.128819 (+ 913us) server_negotiation.cc:407] Connection header received
0809 19:01:21.130665 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:21.130671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:21.130749 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:21.130855 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:21.132249 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:21.133227 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:21.134686 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:21.135215 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:21.135339 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:21.138801 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:21.138806 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:21.138809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:21.138841 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:21.141222 (+ 2381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:21.141982 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:21.141985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:21.141987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:21.142097 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:21.142526 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:21.142530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:21.142533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:21.142857 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:21.142994 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:21.143600 (+ 606us) server_negotiation.cc:299] Negotiation successful
0809 19:01:21.143815 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":298,"threads_started":1}
I20260809 19:01:21.144819 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:21.127869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:42717 (local address 127.16.188.193:39343)
0809 19:01:21.128657 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:21.128710 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:21.130408 (+ 1698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:21.131034 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:21.131042 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:21.131537 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:21.132078 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:21.132094 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:21.133354 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:21.133357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:21.134540 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:21.134558 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:21.135393 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:21.135398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:21.135584 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:21.136177 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:21.136197 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:21.138593 (+ 2396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:21.141347 (+ 2754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:21.141355 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:21.141370 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:21.141889 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:21.142185 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:21.142189 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:21.142193 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:21.142429 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:21.142964 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:21.142970 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:21.143252 (+ 282us) client_negotiation.cc:769] Sending connection context
0809 19:01:21.143464 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 19:01:21.143811 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":301,"threads_started":1}
I20260809 19:01:21.146224 15589 heartbeater.cc:347] Connected to a master server at 127.16.188.254:42717
I20260809 19:01:21.146525 15589 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:21.147344 15589 heartbeater.cc:511] Master 127.16.188.254:42717 requested a full tablet report, sending...
I20260809 19:01:21.149443 15305 ts_manager.cc:194] Registered new tserver with Master: f701fbe17eaa4a70b4d6d935ee36919a (127.16.188.193:46709)
I20260809 19:01:21.150830 15305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.193@KRBTEST.COM'} at 127.16.188.193:39343
WARNING: no policy specified for kudu/127.16.188.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
Entry for principal kudu/127.16.188.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab.
I20260809 19:01:21.191479 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:42717
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:21.510743 15598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:21.511003 15598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:21.511132 15598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:21.518046 15598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:21.518137 15598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:21.518278 15598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:01:21.527397 15598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.194.keytab
--principal=kudu/127.16.188.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:42717
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:21.528508 15598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:21.529732 15598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:21.541869 15606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:21.541800 15613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:21.541831 15611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:21.542852 15598 server_base.cc:1034] running on GCE node
I20260809 19:01:21.543380 15598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:21.544202 15598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:21.545378 15598 hybrid_clock.cc:648] HybridClock initialized: now 1786302081545335 us; error 37 us; skew 500 ppm
I20260809 19:01:21.545655 15598 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:21 dist-test-slave-266d krb5kdc[15226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302081, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:21.548403 15598 init.cc:377] Logged in from keytab as kudu/127.16.188.194@KRBTEST.COM (short username kudu)
I20260809 19:01:21.549719 15598 webserver.cc:460] Webserver started at http://127.16.188.194:34509/ using document root <none> and password file <none>
I20260809 19:01:21.550324 15598 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:21.550438 15598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:21.550712 15598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:21.553411 15598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "8139ace56ac64016a912d32c3e44a93a"
format_stamp: "Formatted at 2026-08-09 19:01:21 on dist-test-slave-266d"
server_key: "e161ce18da5290767c7896932e6264e0"
server_key_iv: "348e3ef012c53bbaccd46d3507b97a33"
server_key_version: "encryptionkey@0"
I20260809 19:01:21.554104 15598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "8139ace56ac64016a912d32c3e44a93a"
format_stamp: "Formatted at 2026-08-09 19:01:21 on dist-test-slave-266d"
server_key: "e161ce18da5290767c7896932e6264e0"
server_key_iv: "348e3ef012c53bbaccd46d3507b97a33"
server_key_version: "encryptionkey@0"
I20260809 19:01:21.558797 15598 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:01:21.562026 15623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:21.563180 15598 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:01:21.563339 15598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "8139ace56ac64016a912d32c3e44a93a"
format_stamp: "Formatted at 2026-08-09 19:01:21 on dist-test-slave-266d"
server_key: "e161ce18da5290767c7896932e6264e0"
server_key_iv: "348e3ef012c53bbaccd46d3507b97a33"
server_key_version: "encryptionkey@0"
I20260809 19:01:21.563503 15598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:21.591454 15598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:21.595196 15598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:21.595461 15598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:21.596385 15598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:21.597659 15598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:21.597734 15598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:21.597860 15598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:21.597913 15598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:21.628172 15598 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:46855
I20260809 19:01:21.628222 15795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:46855 every 8 connection(s)
I20260809 19:01:21.629405 15598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:01:21.636684 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 15598
I20260809 19:01:21.636842 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 19:01:21.637344 17139 external_mini_cluster.cc:1428] Setting key cb4be432f078ba5c5652bcb904484eca
Aug 09 19:01:21 dist-test-slave-266d krb5kdc[15226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302081, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.194@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:21.648670 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:21.631770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:48431 (local address 127.16.188.254:42717)
0809 19:01:21.631973 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:21.631979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:21.633124 (+ 1145us) server_negotiation.cc:407] Connection header received
0809 19:01:21.634876 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:21.634881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:21.634951 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:21.635036 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:21.636393 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:21.637173 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:21.639060 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:21.639530 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:21.639619 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:21.643398 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:21.643403 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:21.643406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:21.643437 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:21.645943 (+ 2506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:21.646689 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:21.646692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:21.646694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:21.646814 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:21.647216 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:21.647218 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:21.647220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:21.647449 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:21.647562 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:21.648284 (+ 722us) server_negotiation.cc:299] Negotiation successful
0809 19:01:21.648442 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:01:21.649876 15799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:21.632277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:42717 (local address 127.16.188.194:48431)
0809 19:01:21.632947 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:21.632983 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:21.634641 (+ 1658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:21.635214 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:21.635222 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:21.635720 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:21.636238 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:21.636255 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:21.637324 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:21.637329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:21.638931 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:21.638945 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:21.639764 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:21.639772 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:21.640043 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:21.640702 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:21.640731 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:21.643188 (+ 2457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:21.646073 (+ 2885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:21.646082 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:21.646096 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:21.646585 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:21.646903 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:21.646908 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:21.646911 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:21.647129 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:21.647558 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:21.647565 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:21.647933 (+ 368us) client_negotiation.cc:769] Sending connection context
0809 19:01:21.648215 (+ 282us) client_negotiation.cc:240] Negotiation successful
0809 19:01:21.648665 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":245,"threads_started":1}
I20260809 19:01:21.651080 15796 heartbeater.cc:347] Connected to a master server at 127.16.188.254:42717
I20260809 19:01:21.651371 15796 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:21.652133 15796 heartbeater.cc:511] Master 127.16.188.254:42717 requested a full tablet report, sending...
I20260809 19:01:21.653616 15305 ts_manager.cc:194] Registered new tserver with Master: 8139ace56ac64016a912d32c3e44a93a (127.16.188.194:46855)
I20260809 19:01:21.654382 15305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.194@KRBTEST.COM'} at 127.16.188.194:48431
WARNING: no policy specified for kudu/127.16.188.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
Entry for principal kudu/127.16.188.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab.
I20260809 19:01:21.699291 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:42717
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:22.019527 15803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:22.019800 15803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:22.019935 15803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:22.026973 15803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:22.027073 15803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:22.027223 15803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:01:22.036649 15803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.195.keytab
--principal=kudu/127.16.188.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:42717
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:22.037880 15803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:22.039094 15803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:22.051126 15810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:22.051204 15814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:22.051350 15819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:22.051880 15803 server_base.cc:1034] running on GCE node
I20260809 19:01:22.052464 15803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:22.053352 15803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:22.054555 15803 hybrid_clock.cc:648] HybridClock initialized: now 1786302082054501 us; error 47 us; skew 500 ppm
I20260809 19:01:22.054859 15803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:22 dist-test-slave-266d krb5kdc[15226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302082, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:22.057822 15803 init.cc:377] Logged in from keytab as kudu/127.16.188.195@KRBTEST.COM (short username kudu)
I20260809 19:01:22.059122 15803 webserver.cc:460] Webserver started at http://127.16.188.195:43553/ using document root <none> and password file <none>
I20260809 19:01:22.059746 15803 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:22.059862 15803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:22.060149 15803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:22.063083 15803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "45045c6f048c4d97bfc9525617b234ce"
format_stamp: "Formatted at 2026-08-09 19:01:22 on dist-test-slave-266d"
server_key: "d16f70fd9618b9583aedec0f334ab285"
server_key_iv: "5603f97cb4fa7d9267dde27972ccee51"
server_key_version: "encryptionkey@0"
I20260809 19:01:22.063825 15803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "45045c6f048c4d97bfc9525617b234ce"
format_stamp: "Formatted at 2026-08-09 19:01:22 on dist-test-slave-266d"
server_key: "d16f70fd9618b9583aedec0f334ab285"
server_key_iv: "5603f97cb4fa7d9267dde27972ccee51"
server_key_version: "encryptionkey@0"
I20260809 19:01:22.069067 15803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:01:22.072338 15827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:22.073580 15803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 19:01:22.073746 15803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "45045c6f048c4d97bfc9525617b234ce"
format_stamp: "Formatted at 2026-08-09 19:01:22 on dist-test-slave-266d"
server_key: "d16f70fd9618b9583aedec0f334ab285"
server_key_iv: "5603f97cb4fa7d9267dde27972ccee51"
server_key_version: "encryptionkey@0"
I20260809 19:01:22.073926 15803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:22.092015 15803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:22.095760 15803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:22.096029 15803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:22.096959 15803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:22.098244 15803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:22.098322 15803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:22.098448 15803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:22.098500 15803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:22.128314 15803 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:41533
I20260809 19:01:22.128400 15993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:41533 every 8 connection(s)
I20260809 19:01:22.129519 15803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:01:22.133515 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 15803
I20260809 19:01:22.133731 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 19:01:22.134271 17139 external_mini_cluster.cc:1428] Setting key fb455ad7bc32937210c7c625196098af
Aug 09 19:01:22 dist-test-slave-266d krb5kdc[15226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302082, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.195@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:22.149325 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.131897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:50379 (local address 127.16.188.254:42717)
0809 19:01:22.132071 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.132075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.133216 (+ 1141us) server_negotiation.cc:407] Connection header received
0809 19:01:22.135537 (+ 2321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.135542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.135632 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.135721 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:22.137530 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.138300 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.140018 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.140404 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.140490 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.143992 (+ 3502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:22.143996 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:22.143999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:22.144033 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:22.146406 (+ 2373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.147087 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.147091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.147093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.147216 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.147621 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.147625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.147627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.147909 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:22.148046 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.148743 (+ 697us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.148968 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:01:22.150238 15996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.132304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:42717 (local address 127.16.188.195:50379)
0809 19:01:22.133008 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:22.133044 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:22.135250 (+ 2206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:22.135991 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:22.135999 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:22.136623 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:22.137378 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.137401 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.138447 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.138451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.139894 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.139910 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.140614 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.140620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.140836 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.141519 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:01:22.141553 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:22.143781 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:22.146536 (+ 2755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:22.146545 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:22.146563 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:22.146964 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:22.147325 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:01:22.147330 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:01:22.147333 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:01:22.147510 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:01:22.148037 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:22.148045 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:22.148372 (+ 327us) client_negotiation.cc:769] Sending connection context
0809 19:01:22.148604 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 19:01:22.149178 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":259,"threads_started":1}
I20260809 19:01:22.151458 15994 heartbeater.cc:347] Connected to a master server at 127.16.188.254:42717
I20260809 19:01:22.151719 15994 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:22.152393 15994 heartbeater.cc:511] Master 127.16.188.254:42717 requested a full tablet report, sending...
I20260809 19:01:22.153740 15305 ts_manager.cc:194] Registered new tserver with Master: 45045c6f048c4d97bfc9525617b234ce (127.16.188.195:41533)
I20260809 19:01:22.153918 15589 heartbeater.cc:503] Master 127.16.188.254:42717 was elected leader, sending a full tablet report...
I20260809 19:01:22.154574 15305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.188.195@KRBTEST.COM'} at 127.16.188.195:50379
I20260809 19:01:22.161201 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:01:22.175943 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.165075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52910 (local address 127.16.188.254:42717)
0809 19:01:22.165255 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.165260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.165751 (+ 491us) server_negotiation.cc:407] Connection header received
0809 19:01:22.165908 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.165911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.165968 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.166033 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:22.167384 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.168075 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.169302 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.169683 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.169777 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.171823 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:22.171828 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:22.171831 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:22.171859 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:22.174017 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.174535 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.174538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.174540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.174647 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.174911 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.174914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.174916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.175189 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:22.175359 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.175592 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.175735 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 19:01:22.179751 15304 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:01:22.186647 15304 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:01:22.209810 16021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.199274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33298 (local address 127.16.188.194:46855)
0809 19:01:22.201584 (+ 2310us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.201592 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.201617 (+ 25us) server_negotiation.cc:407] Connection header received
0809 19:01:22.201712 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.201718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.201952 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.202775 (+ 823us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:22.203045 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.204479 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.207184 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.208614 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.208806 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.208994 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.209303 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.209478 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2161,"thread_start_us":2061,"threads_started":1}
I20260809 19:01:22.210153 16022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.201318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54190 (local address 127.16.188.193:46709)
0809 19:01:22.202033 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.202042 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.203445 (+ 1403us) server_negotiation.cc:407] Connection header received
0809 19:01:22.203612 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.203620 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.203814 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.204034 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:22.204510 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.206114 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.207995 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.208997 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.209221 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.209379 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.209682 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.209852 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":366,"threads_started":1}
I20260809 19:01:22.210494 16017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.198889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:46855 (local address 127.0.0.1:33298)
0809 19:01:22.200980 (+ 2091us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:22.200998 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:22.201131 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:22.202198 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:22.202206 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:22.202240 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:22.202739 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.202759 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.204600 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.204604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.207038 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.207056 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.208830 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.208837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.209029 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.209113 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 19:01:22.209255 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 19:01:22.209437 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1975,"mutex_wait_us":99,"thread_start_us":616,"threads_started":1}
I20260809 19:01:22.210600 16025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.201577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:46709 (local address 127.0.0.1:54190)
0809 19:01:22.203324 (+ 1747us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:22.203341 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:22.203462 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:22.204013 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:22.204016 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:22.204041 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:22.204362 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.204373 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.206257 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.206271 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.207855 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.207866 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.209281 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.209290 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.209468 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.209504 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 19:01:22.209621 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 19:01:22.209745 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1629,"thread_start_us":1497,"threads_started":1}
I20260809 19:01:22.211606 16019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.198191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:41533 (local address 127.0.0.1:54366)
0809 19:01:22.199871 (+ 1680us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:22.199909 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:22.200098 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:22.202441 (+ 2343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:22.202447 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:22.202479 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:22.203087 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.203108 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.204793 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.204799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.206938 (+ 2139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.206951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.210657 (+ 3706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.210666 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.210931 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.210970 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 19:01:22.211077 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 19:01:22.211205 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1447,"mutex_wait_us":55,"thread_start_us":2535,"threads_started":1}
I20260809 19:01:22.212049 16018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.198459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54366 (local address 127.16.188.195:41533)
0809 19:01:22.200830 (+ 2371us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.200841 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.200880 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:01:22.200990 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.201000 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.202119 (+ 1119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.202329 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:22.203324 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.204641 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.207111 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.208643 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.208847 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.208994 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.211578 (+ 2584us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.211741 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2172,"thread_start_us":1968,"threads_started":1}
I20260809 19:01:22.214118 15707 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd1f8f101ed4432bc2f89434698dc5a (DEFAULT_TABLE table=test-table [id=097cea72709c4a669f5f4f445632e6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:22.214397 15494 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd1f8f101ed4432bc2f89434698dc5a (DEFAULT_TABLE table=test-table [id=097cea72709c4a669f5f4f445632e6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:22.215647 15707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd1f8f101ed4432bc2f89434698dc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:22.216023 15494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd1f8f101ed4432bc2f89434698dc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:22.215566 15895 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd1f8f101ed4432bc2f89434698dc5a (DEFAULT_TABLE table=test-table [id=097cea72709c4a669f5f4f445632e6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:22.217020 15895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd1f8f101ed4432bc2f89434698dc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:22.226074 16028 tablet_bootstrap.cc:492] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Bootstrap starting.
I20260809 19:01:22.229310 16028 tablet_bootstrap.cc:654] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:22.230297 16028 log.cc:824] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:22.230815 16029 tablet_bootstrap.cc:492] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Bootstrap starting.
I20260809 19:01:22.232472 16030 tablet_bootstrap.cc:492] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Bootstrap starting.
I20260809 19:01:22.234186 16029 tablet_bootstrap.cc:654] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:22.235405 16029 log.cc:824] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:22.235751 16030 tablet_bootstrap.cc:654] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:22.235910 16028 tablet_bootstrap.cc:492] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: No bootstrap required, opened a new log
I20260809 19:01:22.236233 16028 ts_tablet_manager.cc:1397] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260809 19:01:22.237056 16030 log.cc:824] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:22.239756 16030 tablet_bootstrap.cc:492] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: No bootstrap required, opened a new log
I20260809 19:01:22.240033 16030 ts_tablet_manager.cc:1397] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 19:01:22.242398 16029 tablet_bootstrap.cc:492] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: No bootstrap required, opened a new log
I20260809 19:01:22.242656 16029 ts_tablet_manager.cc:1397] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260809 19:01:22.246400 16028 raft_consensus.cc:348] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.246942 16028 raft_consensus.cc:374] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:22.247078 16028 raft_consensus.cc:729] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8139ace56ac64016a912d32c3e44a93a, State: Initialized, Role: FOLLOWER
I20260809 19:01:22.247845 16028 consensus_queue.cc:260] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.248318 16030 raft_consensus.cc:348] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.248930 16030 raft_consensus.cc:374] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:22.249117 16030 raft_consensus.cc:729] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45045c6f048c4d97bfc9525617b234ce, State: Initialized, Role: FOLLOWER
I20260809 19:01:22.249140 15796 heartbeater.cc:503] Master 127.16.188.254:42717 was elected leader, sending a full tablet report...
I20260809 19:01:22.249701 16028 ts_tablet_manager.cc:1428] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 19:01:22.249904 16030 consensus_queue.cc:260] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.250976 15994 heartbeater.cc:503] Master 127.16.188.254:42717 was elected leader, sending a full tablet report...
I20260809 19:01:22.251704 16030 ts_tablet_manager.cc:1428] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
I20260809 19:01:22.252446 16029 raft_consensus.cc:348] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.252737 16029 raft_consensus.cc:374] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:22.252842 16029 raft_consensus.cc:729] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f701fbe17eaa4a70b4d6d935ee36919a, State: Initialized, Role: FOLLOWER
I20260809 19:01:22.253368 16029 consensus_queue.cc:260] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.255398 16029 ts_tablet_manager.cc:1428] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260809 19:01:22.377254 15590 tablet.cc:2369] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:01:22.381023 15995 tablet.cc:2369] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:01:22.381250 15798 tablet.cc:2369] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:22.428064 16040 raft_consensus.cc:482] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:01:22.428352 16040 raft_consensus.cc:504] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.430176 16040 leader_election.cc:288] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45045c6f048c4d97bfc9525617b234ce (127.16.188.195:41533), 8139ace56ac64016a912d32c3e44a93a (127.16.188.194:46855)
I20260809 19:01:22.436980 16018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.430647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:39899 (local address 127.16.188.195:41533)
0809 19:01:22.430860 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.430866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.431544 (+ 678us) server_negotiation.cc:407] Connection header received
0809 19:01:22.431719 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.431724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.431805 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.431871 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:22.432499 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.433371 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.435359 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.436088 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.436242 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.436339 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.436650 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.436741 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:01:22.437211 16041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.430657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:41533 (local address 127.16.188.193:39899)
0809 19:01:22.431429 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:22.431449 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:22.431579 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:22.431919 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:22.431923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:22.431947 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:22.432356 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.432369 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.433487 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.433491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.435216 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.435228 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.436323 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.436330 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.436497 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.436535 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 19:01:22.436631 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 19:01:22.436752 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":26,"spinlock_wait_cycles":1792,"thread_start_us":394,"threads_started":1}
I20260809 19:01:22.437285 16043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.430738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:46855 (local address 127.16.188.193:37673)
0809 19:01:22.431538 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:22.431556 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:22.431683 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:22.432020 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:22.432023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:22.432056 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:22.432400 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.432408 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.433667 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.433671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.435247 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:22.435259 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.436539 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.436544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:22.436700 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.436731 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 19:01:22.436810 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 19:01:22.436928 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":2,"thread_start_us":478,"threads_started":1}
I20260809 19:01:22.437443 16021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.430873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:37673 (local address 127.16.188.194:46855)
0809 19:01:22.431084 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.431089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.431678 (+ 589us) server_negotiation.cc:407] Connection header received
0809 19:01:22.431818 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.431822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.431906 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.431992 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:22.432570 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.433502 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.435394 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.436163 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.436319 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.436393 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.436855 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.436978 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 19:01:22.438388 15735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd1f8f101ed4432bc2f89434698dc5a" candidate_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8139ace56ac64016a912d32c3e44a93a" is_pre_election: true
I20260809 19:01:22.438601 15925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd1f8f101ed4432bc2f89434698dc5a" candidate_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45045c6f048c4d97bfc9525617b234ce" is_pre_election: true
I20260809 19:01:22.438881 15735 raft_consensus.cc:2454] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f701fbe17eaa4a70b4d6d935ee36919a in term 0.
I20260809 19:01:22.439054 15925 raft_consensus.cc:2454] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f701fbe17eaa4a70b4d6d935ee36919a in term 0.
I20260809 19:01:22.439517 15420 leader_election.cc:302] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8139ace56ac64016a912d32c3e44a93a, f701fbe17eaa4a70b4d6d935ee36919a; no voters:
I20260809 19:01:22.439903 16040 raft_consensus.cc:2781] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:01:22.440032 16040 raft_consensus.cc:482] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:01:22.440124 16040 raft_consensus.cc:3037] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:22.442340 16040 raft_consensus.cc:504] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.442915 16040 leader_election.cc:288] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [CANDIDATE]: Term 1 election: Requested vote from peers 45045c6f048c4d97bfc9525617b234ce (127.16.188.195:41533), 8139ace56ac64016a912d32c3e44a93a (127.16.188.194:46855)
I20260809 19:01:22.443292 15925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd1f8f101ed4432bc2f89434698dc5a" candidate_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45045c6f048c4d97bfc9525617b234ce"
I20260809 19:01:22.443351 15735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd1f8f101ed4432bc2f89434698dc5a" candidate_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8139ace56ac64016a912d32c3e44a93a"
I20260809 19:01:22.443454 15925 raft_consensus.cc:3037] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:22.443529 15735 raft_consensus.cc:3037] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:22.445616 15925 raft_consensus.cc:2454] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f701fbe17eaa4a70b4d6d935ee36919a in term 1.
I20260809 19:01:22.445712 15735 raft_consensus.cc:2454] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f701fbe17eaa4a70b4d6d935ee36919a in term 1.
I20260809 19:01:22.445992 15422 leader_election.cc:302] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45045c6f048c4d97bfc9525617b234ce, f701fbe17eaa4a70b4d6d935ee36919a; no voters:
I20260809 19:01:22.446286 16040 raft_consensus.cc:2781] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:22.446735 16040 raft_consensus.cc:686] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 1 LEADER]: Becoming Leader. State: Replica: f701fbe17eaa4a70b4d6d935ee36919a, State: Running, Role: LEADER
I20260809 19:01:22.447213 16040 consensus_queue.cc:237] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } }
I20260809 19:01:22.451504 15304 catalog_manager.cc:5495] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a reported cstate change: term changed from 0 to 1, leader changed from <none> to f701fbe17eaa4a70b4d6d935ee36919a (127.16.188.193). New cstate: current_term: 1 leader_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f701fbe17eaa4a70b4d6d935ee36919a" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 } health_report { overall_health: UNKNOWN } } }
I20260809 19:01:22.502246 16022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.496958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54196 (local address 127.16.188.193:46709)
0809 19:01:22.497191 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.497197 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.497277 (+ 80us) server_negotiation.cc:407] Connection header received
0809 19:01:22.497490 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.497494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.497579 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.497728 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:22.498110 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.498802 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.500129 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.500550 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.500666 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.501166 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:22.501662 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:22.501794 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.501901 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.501981 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 19:01:22.509865 15925 raft_consensus.cc:1261] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 1 FOLLOWER]: Refusing update from remote peer f701fbe17eaa4a70b4d6d935ee36919a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:22.509866 15735 raft_consensus.cc:1261] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 1 FOLLOWER]: Refusing update from remote peer f701fbe17eaa4a70b4d6d935ee36919a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:22.510761 16046 consensus_queue.cc:1035] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8139ace56ac64016a912d32c3e44a93a" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 46855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:22.511098 16040 consensus_queue.cc:1035] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45045c6f048c4d97bfc9525617b234ce" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:22.521991 16049 mvcc.cc:205] Tried to move back new op lower bound from 7316693329951051776 to 7316693329707339776. Current Snapshot: MvccSnapshot[applied={T|T < 7316693329951051776}]
I20260809 19:01:22.523064 16050 mvcc.cc:205] Tried to move back new op lower bound from 7316693329951051776 to 7316693329707339776. Current Snapshot: MvccSnapshot[applied={T|T < 7316693329951051776}]
I20260809 19:01:22.542452 15304 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:22.542689 15304 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:22.546079 15304 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b7a675ac0d447c3aa5d0e2dc1cf6619: Sending DeleteTablet for 3 replicas of tablet 4dd1f8f101ed4432bc2f89434698dc5a
I20260809 19:01:22.547199 15895 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd1f8f101ed4432bc2f89434698dc5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:22 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:54366
I20260809 19:01:22.547176 15707 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd1f8f101ed4432bc2f89434698dc5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:22 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:33298
I20260809 19:01:22.547396 15494 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd1f8f101ed4432bc2f89434698dc5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:22 UTC) from {username='kudu', principal='kudu/127.16.188.254@KRBTEST.COM'} at 127.0.0.1:54190
I20260809 19:01:22.548970 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 15395
I20260809 19:01:22.557505 16064 tablet_replica.cc:330] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: stopping tablet replica
I20260809 19:01:22.558465 16060 tablet_replica.cc:330] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: stopping tablet replica
I20260809 19:01:22.558964 16060 raft_consensus.cc:2229] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:22.559508 16060 raft_consensus.cc:2258] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:22.560343 16063 tablet_replica.cc:330] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: stopping tablet replica
I20260809 19:01:22.560770 16063 raft_consensus.cc:2229] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:22.560922 16064 raft_consensus.cc:2229] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:01:22.561292 16063 raft_consensus.cc:2258] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:22.561990 16060 ts_tablet_manager.cc:1905] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:22.561990 16064 raft_consensus.cc:2258] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:22.563885 16064 ts_tablet_manager.cc:1905] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:22.566964 16063 ts_tablet_manager.cc:1905] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 19:01:22 dist-test-slave-266d krb5kdc[15226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.193@KRBTEST.COM
I20260809 19:01:22.571069 16064 ts_tablet_manager.cc:1918] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:22.571312 16064 log.cc:1196] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/4dd1f8f101ed4432bc2f89434698dc5a
I20260809 19:01:22.571920 16064 ts_tablet_manager.cc:1939] T 4dd1f8f101ed4432bc2f89434698dc5a P f701fbe17eaa4a70b4d6d935ee36919a: Deleting consensus metadata
I20260809 19:01:22.571957 16060 ts_tablet_manager.cc:1918] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:22.573918 16063 ts_tablet_manager.cc:1918] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:22.574045 16063 log.cc:1196] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/4dd1f8f101ed4432bc2f89434698dc5a
I20260809 19:01:22.574438 16063 ts_tablet_manager.cc:1939] T 4dd1f8f101ed4432bc2f89434698dc5a P 8139ace56ac64016a912d32c3e44a93a: Deleting consensus metadata
I20260809 19:01:22.575465 15284 catalog_manager.cc:4841] TS f701fbe17eaa4a70b4d6d935ee36919a (127.16.188.193:46709): tablet 4dd1f8f101ed4432bc2f89434698dc5a (table test-table [id=097cea72709c4a669f5f4f445632e6fa]) successfully deleted
I20260809 19:01:22.575763 15283 catalog_manager.cc:4841] TS 8139ace56ac64016a912d32c3e44a93a (127.16.188.194:46855): tablet 4dd1f8f101ed4432bc2f89434698dc5a (table test-table [id=097cea72709c4a669f5f4f445632e6fa]) successfully deleted
I20260809 19:01:22.577286 16060 log.cc:1196] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/4dd1f8f101ed4432bc2f89434698dc5a
I20260809 19:01:22.577873 16060 ts_tablet_manager.cc:1939] T 4dd1f8f101ed4432bc2f89434698dc5a P 45045c6f048c4d97bfc9525617b234ce: Deleting consensus metadata
I20260809 19:01:22.578259 16022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.551598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54210 (local address 127.16.188.193:46709)
0809 19:01:22.552046 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.552053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.557900 (+ 5847us) server_negotiation.cc:407] Connection header received
0809 19:01:22.558074 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.558080 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.558161 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.558263 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:22.561716 (+ 3453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.562971 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.564917 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.565704 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.565821 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.571206 (+ 5385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:22.571219 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:22.571234 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:22.571281 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:22.575137 (+ 3856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.576020 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.576028 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.576032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.576194 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.576564 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.576569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.576572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.577043 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:22.577429 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.577662 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.577904 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321}
I20260809 19:01:22.579250 15581 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:22.579510 15284 catalog_manager.cc:4841] TS 45045c6f048c4d97bfc9525617b234ce (127.16.188.195:41533): tablet 4dd1f8f101ed4432bc2f89434698dc5a (table test-table [id=097cea72709c4a669f5f4f445632e6fa]) successfully deleted
I20260809 19:01:22.674558 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 15395
I20260809 19:01:22.699596 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 15598
Aug 09 19:01:22 dist-test-slave-266d krb5kdc[15226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.194@KRBTEST.COM
I20260809 19:01:22.713575 16021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.700321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33312 (local address 127.16.188.194:46855)
0809 19:01:22.700499 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.700503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.700570 (+ 67us) server_negotiation.cc:407] Connection header received
0809 19:01:22.700722 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.700726 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.700796 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.700875 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:22.702058 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.702783 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.703946 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.704325 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.704408 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.708366 (+ 3958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:22.708378 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:22.708392 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:22.708423 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:22.711017 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.711638 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.711644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.711647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.711772 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.712110 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.712114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.712116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.712464 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:22.712752 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.713019 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.713249 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:01:22.714164 15789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:22.800200 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 15598
I20260809 19:01:22.827672 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 15803
Aug 09 19:01:22 dist-test-slave-266d krb5kdc[15226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.195@KRBTEST.COM
I20260809 19:01:22.842375 16018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:22.828432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54382 (local address 127.16.188.195:41533)
0809 19:01:22.828621 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:22.828627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:22.828648 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:01:22.828785 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:22.828789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:22.828862 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:22.828948 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:22.830289 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.830995 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.832320 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:22.832709 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:22.832820 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:22.837137 (+ 4317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:22.837157 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:22.837176 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:22.837210 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:22.839691 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.840331 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.840338 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.840340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.840488 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:22.840843 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:22.840847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:22.840849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:22.841269 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:22.841541 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:22.841853 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 19:01:22.842066 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:01:22.842989 15985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:22.929244 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 15803
I20260809 19:01:22.953049 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 15248
I20260809 19:01:22.954152 15351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:23.060967 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 15248
2026-08-09T19:01:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4492 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T19:01:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:23Z Disabled control of system clock
I20260809 19:01:23.149511 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40651
--webserver_interface=127.16.188.254
--webserver_port=0
--builtin_ntp_servers=127.16.188.212:39495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:40651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:01:23.477020 16074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:23.477342 16074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:23.477475 16074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:23.484756 16074 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:23.484997 16074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:23.485121 16074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:23.485227 16074 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:23.485297 16074 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:23.494715 16074 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:40651
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:23.496066 16074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:23.497998 16074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:23.510100 16082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:23.510124 16094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:23.510043 16089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:23.511130 16074 server_base.cc:1034] running on GCE node
I20260809 19:01:23.511813 16074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:23.513175 16074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:23.514384 16074 hybrid_clock.cc:648] HybridClock initialized: now 1786302083514333 us; error 47 us; skew 500 ppm
I20260809 19:01:23.514698 16074 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:23.519500 16074 webserver.cc:460] Webserver started at http://127.16.188.254:42545/ using document root <none> and password file <none>
I20260809 19:01:23.520164 16074 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:23.520252 16074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:23.520529 16074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:23.523412 16074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "227252ab419c497da11a4ccc61b72fe3"
format_stamp: "Formatted at 2026-08-09 19:01:23 on dist-test-slave-266d"
server_key: "bb3c333c858605979ba16ba5835fd01c"
server_key_iv: "d16893a8bbda6449f1cafcf111692704"
server_key_version: "encryptionkey@0"
I20260809 19:01:23.524154 16074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "227252ab419c497da11a4ccc61b72fe3"
format_stamp: "Formatted at 2026-08-09 19:01:23 on dist-test-slave-266d"
server_key: "bb3c333c858605979ba16ba5835fd01c"
server_key_iv: "d16893a8bbda6449f1cafcf111692704"
server_key_version: "encryptionkey@0"
I20260809 19:01:23.529204 16074 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 19:01:23.532487 16111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:23.533742 16074 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:23.533882 16074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "227252ab419c497da11a4ccc61b72fe3"
format_stamp: "Formatted at 2026-08-09 19:01:23 on dist-test-slave-266d"
server_key: "bb3c333c858605979ba16ba5835fd01c"
server_key_iv: "d16893a8bbda6449f1cafcf111692704"
server_key_version: "encryptionkey@0"
I20260809 19:01:23.534054 16074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:23.556808 16074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:23.557618 16074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:23.557873 16074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:23.574553 16074 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:40651
I20260809 19:01:23.574571 16194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:40651 every 8 connection(s)
I20260809 19:01:23.575834 16074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:23.579422 16195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:23.583082 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 16074
I20260809 19:01:23.583256 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:23.583835 17139 external_mini_cluster.cc:1428] Setting key 91161916afac2fbdb18b418fa975fa36
I20260809 19:01:23.592072 16195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3: Bootstrap starting.
I20260809 19:01:23.595479 16195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:23.596608 16195 log.cc:824] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:23.597122 16201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:23.585781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52450 (local address 127.16.188.254:40651)
0809 19:01:23.586716 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:23.586726 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:23.586765 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:01:23.588316 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:23.588339 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:23.588797 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:23.589167 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:23.589729 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:23.591027 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:23.592771 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:23.593501 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:23.593658 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:23.594850 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:23.594857 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:23.594870 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:23.595371 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:23.595482 (+ 111us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:23.595505 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:23.595610 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:23.595818 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 19:01:23.596135 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":341,"threads_started":1}
I20260809 19:01:23.599367 16195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3: No bootstrap required, opened a new log
I20260809 19:01:23.606631 16195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227252ab419c497da11a4ccc61b72fe3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40651 } }
I20260809 19:01:23.606959 16195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:23.607046 16195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227252ab419c497da11a4ccc61b72fe3, State: Initialized, Role: FOLLOWER
I20260809 19:01:23.607551 16195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227252ab419c497da11a4ccc61b72fe3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40651 } }
I20260809 19:01:23.607771 16195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:23.607894 16195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:23.608032 16195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:23.610123 16195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227252ab419c497da11a4ccc61b72fe3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40651 } }
I20260809 19:01:23.610589 16195 leader_election.cc:302] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 227252ab419c497da11a4ccc61b72fe3; no voters:
I20260809 19:01:23.611176 16195 leader_election.cc:288] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:23.611254 16205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:23.611894 16205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [term 1 LEADER]: Becoming Leader. State: Replica: 227252ab419c497da11a4ccc61b72fe3, State: Running, Role: LEADER
I20260809 19:01:23.612389 16205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227252ab419c497da11a4ccc61b72fe3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40651 } }
I20260809 19:01:23.613052 16195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:23.614977 16207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 227252ab419c497da11a4ccc61b72fe3. Latest consensus state: current_term: 1 leader_uuid: "227252ab419c497da11a4ccc61b72fe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227252ab419c497da11a4ccc61b72fe3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40651 } } }
I20260809 19:01:23.615375 16207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:23.617553 16206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "227252ab419c497da11a4ccc61b72fe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227252ab419c497da11a4ccc61b72fe3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40651 } } }
I20260809 19:01:23.617990 16206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:23.618346 16212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:23.623045 16212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:23.631484 16212 catalog_manager.cc:1347] Generated new cluster ID: bcc36a01d1964efa8a29008fddcf3d44
I20260809 19:01:23.631595 16212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:23.659158 16212 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:23.660444 16212 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:23.665704 16212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3: Generated new TSK 0
I20260809 19:01:23.666623 16212 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:23.683460 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.193:0
--local_ip_for_outbound_sockets=127.16.188.193
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40651
--builtin_ntp_servers=127.16.188.212:39495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 19:01:24.020311 16232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:24.020642 16232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:24.020747 16232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:24.027871 16232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:24.027962 16232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:24.028088 16232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.193
I20260809 19:01:24.036916 16232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.188.193
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40651
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.193
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:24.038130 16232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:24.039835 16232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:24.052228 16243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:24.052259 16238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:24.052850 16232 server_base.cc:1034] running on GCE node
W20260809 19:01:24.052917 16240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:24.053596 16232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:24.054430 16232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:24.055634 16232 hybrid_clock.cc:648] HybridClock initialized: now 1786302084055587 us; error 34 us; skew 500 ppm
I20260809 19:01:24.055919 16232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:24.058048 16232 webserver.cc:460] Webserver started at http://127.16.188.193:39489/ using document root <none> and password file <none>
I20260809 19:01:24.058689 16232 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:24.058784 16232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:24.059074 16232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:24.061914 16232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/data/instance:
uuid: "8ca0927de533400ab8728ecbb37648c7"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "c2bfee9dda6effbdf204c6ee400bc57b"
server_key_iv: "e4847fae0dc110981b71bd817ef30c7a"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.062659 16232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance:
uuid: "8ca0927de533400ab8728ecbb37648c7"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "c2bfee9dda6effbdf204c6ee400bc57b"
server_key_iv: "e4847fae0dc110981b71bd817ef30c7a"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.067363 16232 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 19:01:24.070600 16252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:24.071820 16232 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:01:24.071962 16232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/wal
uuid: "8ca0927de533400ab8728ecbb37648c7"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "c2bfee9dda6effbdf204c6ee400bc57b"
server_key_iv: "e4847fae0dc110981b71bd817ef30c7a"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.072146 16232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:24.083731 16232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:24.084440 16232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:24.084715 16232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:24.085692 16232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:24.086995 16232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:24.087097 16232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:24.087203 16232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:24.087270 16232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:24.115967 16232 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.193:44847
I20260809 19:01:24.116032 16435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.193:44847 every 8 connection(s)
I20260809 19:01:24.117317 16232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/data/info.pb
I20260809 19:01:24.122006 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 16232
I20260809 19:01:24.122167 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/wal/instance
I20260809 19:01:24.122573 17139 external_mini_cluster.cc:1428] Setting key e895c4b7f044d597d82eecc46a21ef51
I20260809 19:01:24.125145 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.194:0
--local_ip_for_outbound_sockets=127.16.188.194
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40651
--builtin_ntp_servers=127.16.188.212:39495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:01:24.129276 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:24.119764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.193:33087 (local address 127.16.188.254:40651)
0809 19:01:24.120192 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:24.120197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:24.121405 (+ 1208us) server_negotiation.cc:407] Connection header received
0809 19:01:24.123198 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:24.123203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:24.123292 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:24.123388 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:24.124404 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:24.125119 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:24.126631 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:24.127082 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:24.127205 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:24.128455 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:24.128462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:24.128466 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:24.128483 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:24.128525 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:24.128536 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:24.128615 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:24.128815 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 19:01:24.128910 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":214,"threads_started":1}
I20260809 19:01:24.130162 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:24.120376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40651 (local address 127.16.188.193:33087)
0809 19:01:24.121259 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:24.121304 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:24.122948 (+ 1644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:24.123614 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:24.123622 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:24.123711 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:24.124245 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:24.124261 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:24.125264 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:24.125269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:24.126493 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:24.126505 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:24.127292 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:24.127300 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:24.127525 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:24.128163 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:24.128165 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:24.128216 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:24.128288 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:24.128627 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:24.128639 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:24.128647 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 19:01:24.128806 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 19:01:24.129192 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":257,"threads_started":1}
I20260809 19:01:24.131510 16436 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40651
I20260809 19:01:24.131774 16436 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:24.132453 16436 heartbeater.cc:511] Master 127.16.188.254:40651 requested a full tablet report, sending...
I20260809 19:01:24.134606 16134 ts_manager.cc:194] Registered new tserver with Master: 8ca0927de533400ab8728ecbb37648c7 (127.16.188.193:44847)
I20260809 19:01:24.136430 16134 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.193:33087
W20260809 19:01:24.461433 16440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:24.461730 16440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:24.461871 16440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:24.469074 16440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:24.469204 16440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:24.469359 16440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.194
I20260809 19:01:24.478504 16440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.188.194
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40651
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.194
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:24.479792 16440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:24.481717 16440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:24.494385 16450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:24.494426 16449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:24.494508 16457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:24.495487 16440 server_base.cc:1034] running on GCE node
I20260809 19:01:24.496033 16440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:24.496932 16440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:24.498140 16440 hybrid_clock.cc:648] HybridClock initialized: now 1786302084498086 us; error 58 us; skew 500 ppm
I20260809 19:01:24.498440 16440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:24.500600 16440 webserver.cc:460] Webserver started at http://127.16.188.194:42589/ using document root <none> and password file <none>
I20260809 19:01:24.501295 16440 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:24.501400 16440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:24.501696 16440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:24.504444 16440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/data/instance:
uuid: "3a8977215b0b4754beaea8fc19b0b8e5"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "9afe0e22262bb4fd0ce01feae439a967"
server_key_iv: "e403b487c2e33951c362188c473b761b"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.505235 16440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance:
uuid: "3a8977215b0b4754beaea8fc19b0b8e5"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "9afe0e22262bb4fd0ce01feae439a967"
server_key_iv: "e403b487c2e33951c362188c473b761b"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.510080 16440 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 19:01:24.513411 16467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:24.514670 16440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 19:01:24.514811 16440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/wal
uuid: "3a8977215b0b4754beaea8fc19b0b8e5"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "9afe0e22262bb4fd0ce01feae439a967"
server_key_iv: "e403b487c2e33951c362188c473b761b"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.514992 16440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:24.539027 16440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:24.539830 16440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:24.540112 16440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:24.541065 16440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:24.542533 16440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:24.542629 16440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:24.542743 16440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:24.542816 16440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:24.572285 16440 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.194:43899
I20260809 19:01:24.572358 16625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.194:43899 every 8 connection(s)
I20260809 19:01:24.573618 16440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/data/info.pb
I20260809 19:01:24.575516 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 16440
I20260809 19:01:24.575690 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/wal/instance
I20260809 19:01:24.576253 17139 external_mini_cluster.cc:1428] Setting key b0d424080c019ed726ca35c0ce13834d
I20260809 19:01:24.580592 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.188.195:0
--local_ip_for_outbound_sockets=127.16.188.195
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40651
--builtin_ntp_servers=127.16.188.212:39495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 19:01:24.587656 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:24.578192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.194:41717 (local address 127.16.188.254:40651)
0809 19:01:24.578402 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:24.578408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:24.578431 (+ 23us) server_negotiation.cc:407] Connection header received
0809 19:01:24.579920 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:24.579925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:24.580001 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:24.580099 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:24.581459 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:24.582548 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:24.584598 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:24.585263 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:24.585395 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:24.586847 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:24.586853 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:24.586858 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:24.586879 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:24.586918 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:24.586932 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:24.587014 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:24.587249 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 19:01:24.587347 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 19:01:24.588783 16628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:24.576883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40651 (local address 127.16.188.194:41717)
0809 19:01:24.577817 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:24.577853 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:24.579630 (+ 1777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:24.580352 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:24.580364 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:24.580486 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:24.581289 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:24.581314 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:24.582738 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:24.582743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:24.584448 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:24.584463 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:24.585485 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:24.585492 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:24.585751 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:24.586502 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:24.586505 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:24.586554 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:24.586652 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:24.587026 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:24.587035 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:24.587042 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 19:01:24.587234 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 19:01:24.587593 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":309,"threads_started":1}
I20260809 19:01:24.590209 16626 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40651
I20260809 19:01:24.590515 16626 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:24.591375 16626 heartbeater.cc:511] Master 127.16.188.254:40651 requested a full tablet report, sending...
I20260809 19:01:24.592819 16134 ts_manager.cc:194] Registered new tserver with Master: 3a8977215b0b4754beaea8fc19b0b8e5 (127.16.188.194:43899)
I20260809 19:01:24.593803 16134 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.194:41717
W20260809 19:01:24.909610 16630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:24.909868 16630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:24.909991 16630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:24.917158 16630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:24.917246 16630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:24.917384 16630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.188.195
I20260809 19:01:24.926268 16630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:39495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.188.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.188.195
--webserver_port=0
--tserver_master_addrs=127.16.188.254:40651
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.188.195
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:24.927500 16630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:24.929384 16630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:24.942050 16637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:24.942087 16638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:24.942047 16640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:24.948192 16630 server_base.cc:1034] running on GCE node
I20260809 19:01:24.948784 16630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:24.949725 16630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:24.950927 16630 hybrid_clock.cc:648] HybridClock initialized: now 1786302084950882 us; error 36 us; skew 500 ppm
I20260809 19:01:24.951205 16630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 19:01:24.953308 16630 webserver.cc:460] Webserver started at http://127.16.188.195:45939/ using document root <none> and password file <none>
I20260809 19:01:24.953963 16630 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:24.954049 16630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:24.954296 16630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:24.957059 16630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/data/instance:
uuid: "5c8008761d8d4d1dbc13c4990b43446a"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "7e112c35fe37d7223527ed05f9d44247"
server_key_iv: "e76f6fbd93d8af5098c46c3e724eb41c"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.957855 16630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance:
uuid: "5c8008761d8d4d1dbc13c4990b43446a"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "7e112c35fe37d7223527ed05f9d44247"
server_key_iv: "e76f6fbd93d8af5098c46c3e724eb41c"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.962621 16630 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 19:01:24.965920 16651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:24.967160 16630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:01:24.967298 16630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/wal
uuid: "5c8008761d8d4d1dbc13c4990b43446a"
format_stamp: "Formatted at 2026-08-09 19:01:24 on dist-test-slave-266d"
server_key: "7e112c35fe37d7223527ed05f9d44247"
server_key_iv: "e76f6fbd93d8af5098c46c3e724eb41c"
server_key_version: "encryptionkey@0"
I20260809 19:01:24.967463 16630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:25.006193 16630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:25.006983 16630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:25.007239 16630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:25.008159 16630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 19:01:25.009610 16630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 19:01:25.009697 16630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:25.009784 16630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 19:01:25.009838 16630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:25.041961 16630 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.195:43347
I20260809 19:01:25.042011 16832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.195:43347 every 8 connection(s)
I20260809 19:01:25.043318 16630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/data/info.pb
I20260809 19:01:25.051755 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 16630
I20260809 19:01:25.051910 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/wal/instance
I20260809 19:01:25.052332 17139 external_mini_cluster.cc:1428] Setting key 543b061fd41dfd081f0dc72fd3fe686d
I20260809 19:01:25.056133 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.045849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:52133 (local address 127.16.188.254:40651)
0809 19:01:25.046039 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.046043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.047382 (+ 1339us) server_negotiation.cc:407] Connection header received
0809 19:01:25.049181 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.049185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.049252 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.049338 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:25.050411 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.051209 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.053005 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.053661 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.053786 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.055242 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:25.055249 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:25.055253 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:25.055272 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:25.055307 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:25.055321 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:25.055404 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.055641 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.055748 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:01:25.057073 16838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.046317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:40651 (local address 127.16.188.195:52133)
0809 19:01:25.047221 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:25.047270 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:25.048912 (+ 1642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:25.049547 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:25.049577 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:25.049671 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:01:25.050245 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.050262 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.051373 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.051377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.052851 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.052868 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.053881 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.053886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.054184 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.054885 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 19:01:25.054888 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:01:25.054942 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 19:01:25.055048 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:01:25.055417 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:01:25.055429 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:01:25.055438 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 19:01:25.055616 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 19:01:25.055996 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":282,"threads_started":1}
I20260809 19:01:25.058374 16836 heartbeater.cc:347] Connected to a master server at 127.16.188.254:40651
I20260809 19:01:25.058676 16836 heartbeater.cc:464] Registering TS with master...
I20260809 19:01:25.059406 16836 heartbeater.cc:511] Master 127.16.188.254:40651 requested a full tablet report, sending...
I20260809 19:01:25.060740 16134 ts_manager.cc:194] Registered new tserver with Master: 5c8008761d8d4d1dbc13c4990b43446a (127.16.188.195:43347)
I20260809 19:01:25.061604 16134 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.188.195:52133
I20260809 19:01:25.067358 17139 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 19:01:25.076812 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.071274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52452 (local address 127.16.188.254:40651)
0809 19:01:25.071513 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.071521 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.071899 (+ 378us) server_negotiation.cc:407] Connection header received
0809 19:01:25.072046 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.072050 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.072120 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.072195 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:25.072689 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.073405 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.074689 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.075051 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.075131 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.076178 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:25.076182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:25.076185 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:25.076200 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:25.076228 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:25.076238 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:25.076331 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.076463 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.076534 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 19:01:25.080298 16134 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 19:01:25.086848 16134 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 19:01:25.124277 16850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.098484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.195:43347 (local address 127.0.0.1:45610)
0809 19:01:25.113609 (+ 15125us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:25.113662 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:25.113842 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:25.115663 (+ 1821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:25.115671 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:25.115701 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:25.116153 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.116171 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.118257 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.118262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.120966 (+ 2704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.120982 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.123467 (+ 2485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.123474 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.123650 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.123680 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 19:01:25.123744 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 19:01:25.123857 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14979,"mutex_wait_us":124,"thread_start_us":14253,"threads_started":1}
I20260809 19:01:25.124293 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.100987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43930 (local address 127.16.188.193:44847)
0809 19:01:25.107149 (+ 6162us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.107159 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.115139 (+ 7980us) server_negotiation.cc:407] Connection header received
0809 19:01:25.115274 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.115280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.115495 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.115703 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:25.116753 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.118570 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.121462 (+ 2892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.122878 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.123042 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.123235 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.123764 (+ 529us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.123927 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5981,"thread_start_us":5875,"threads_started":1}
I20260809 19:01:25.124512 16852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.098352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36470 (local address 127.16.188.194:43899)
0809 19:01:25.113880 (+ 15528us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.113889 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.114804 (+ 915us) server_negotiation.cc:407] Connection header received
0809 19:01:25.114915 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.114923 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.115166 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.115370 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:25.116484 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.118141 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.121271 (+ 3130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.122651 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.122799 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.123007 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.124031 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.124190 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15368,"thread_start_us":15532,"threads_started":1}
I20260809 19:01:25.124301 16855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.098131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:43899 (local address 127.0.0.1:36470)
0809 19:01:25.113516 (+ 15385us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:25.114207 (+ 691us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:25.114333 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:25.115663 (+ 1330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:25.115702 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:25.115720 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:25.116289 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.116300 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.118275 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.118279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.121007 (+ 2728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.121018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.123144 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.123150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.123431 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.123562 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 19:01:25.123687 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 19:01:25.123858 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15110,"mutex_wait_us":179,"thread_start_us":15852,"threads_started":1}
I20260809 19:01:25.125013 16857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.100455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:44847 (local address 127.0.0.1:43930)
0809 19:01:25.115005 (+ 14550us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:25.115022 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:25.115135 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:25.115972 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:25.115980 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:25.116005 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:25.116549 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.116563 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.118821 (+ 2258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.118826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.121238 (+ 2412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.121252 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.123226 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.123232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.123503 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.123561 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 19:01:25.124543 (+ 982us) client_negotiation.cc:240] Negotiation successful
0809 19:01:25.124674 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14455,"mutex_wait_us":80,"thread_start_us":14312,"threads_started":1}
I20260809 19:01:25.125489 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.098736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45610 (local address 127.16.188.195:43347)
0809 19:01:25.114876 (+ 16140us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.114882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.114910 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:01:25.114987 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.114993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.115166 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.115371 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:25.116440 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.118100 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.121272 (+ 3172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.122651 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.122845 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.123014 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.124954 (+ 1940us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.125143 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15970,"thread_start_us":15827,"threads_started":1}
I20260809 19:01:25.128430 16334 tablet_service.cc:1467] Processing CreateTablet for tablet 40ace46739a0469d889df44071d08517 (DEFAULT_TABLE table=test-table [id=628ceb33bb8a4e319fb65b7b64592cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:25.128561 16532 tablet_service.cc:1467] Processing CreateTablet for tablet 40ace46739a0469d889df44071d08517 (DEFAULT_TABLE table=test-table [id=628ceb33bb8a4e319fb65b7b64592cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:25.128793 16728 tablet_service.cc:1467] Processing CreateTablet for tablet 40ace46739a0469d889df44071d08517 (DEFAULT_TABLE table=test-table [id=628ceb33bb8a4e319fb65b7b64592cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 19:01:25.129751 16334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ace46739a0469d889df44071d08517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:25.130035 16728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ace46739a0469d889df44071d08517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:25.130034 16532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ace46739a0469d889df44071d08517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:25.139710 16436 heartbeater.cc:503] Master 127.16.188.254:40651 was elected leader, sending a full tablet report...
I20260809 19:01:25.143960 16859 tablet_bootstrap.cc:492] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Bootstrap starting.
I20260809 19:01:25.147200 16859 tablet_bootstrap.cc:654] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:25.148108 16859 log.cc:824] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:25.150314 16861 tablet_bootstrap.cc:492] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Bootstrap starting.
I20260809 19:01:25.150781 16860 tablet_bootstrap.cc:492] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Bootstrap starting.
I20260809 19:01:25.151081 16859 tablet_bootstrap.cc:492] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: No bootstrap required, opened a new log
I20260809 19:01:25.151317 16859 ts_tablet_manager.cc:1397] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 19:01:25.153772 16861 tablet_bootstrap.cc:654] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:25.154151 16860 tablet_bootstrap.cc:654] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:25.154964 16861 log.cc:824] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:25.155297 16860 log.cc:824] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:25.157680 16861 tablet_bootstrap.cc:492] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: No bootstrap required, opened a new log
I20260809 19:01:25.157922 16861 ts_tablet_manager.cc:1397] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 19:01:25.158202 16860 tablet_bootstrap.cc:492] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: No bootstrap required, opened a new log
I20260809 19:01:25.158473 16860 ts_tablet_manager.cc:1397] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 19:01:25.159168 16859 raft_consensus.cc:348] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.159603 16859 raft_consensus.cc:374] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:25.159710 16859 raft_consensus.cc:729] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca0927de533400ab8728ecbb37648c7, State: Initialized, Role: FOLLOWER
I20260809 19:01:25.160296 16859 consensus_queue.cc:260] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.161931 16859 ts_tablet_manager.cc:1428] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Time spent starting tablet: real 0.011s user 0.006s sys 0.005s
I20260809 19:01:25.166647 16861 raft_consensus.cc:348] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.166735 16860 raft_consensus.cc:348] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.166954 16861 raft_consensus.cc:374] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:25.167037 16861 raft_consensus.cc:729] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a8977215b0b4754beaea8fc19b0b8e5, State: Initialized, Role: FOLLOWER
I20260809 19:01:25.167052 16860 raft_consensus.cc:374] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:25.167140 16860 raft_consensus.cc:729] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8008761d8d4d1dbc13c4990b43446a, State: Initialized, Role: FOLLOWER
I20260809 19:01:25.167585 16861 consensus_queue.cc:260] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.167627 16860 consensus_queue.cc:260] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.168573 16836 heartbeater.cc:503] Master 127.16.188.254:40651 was elected leader, sending a full tablet report...
I20260809 19:01:25.169001 16860 ts_tablet_manager.cc:1428] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Time spent starting tablet: real 0.010s user 0.006s sys 0.003s
I20260809 19:01:25.169162 16861 ts_tablet_manager.cc:1428] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260809 19:01:25.169582 16626 heartbeater.cc:503] Master 127.16.188.254:40651 was elected leader, sending a full tablet report...
W20260809 19:01:25.295027 16837 tablet.cc:2369] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:25.317428 16874 raft_consensus.cc:482] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 19:01:25.317739 16874 raft_consensus.cc:504] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.319521 16874 leader_election.cc:288] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a8977215b0b4754beaea8fc19b0b8e5 (127.16.188.194:43899), 8ca0927de533400ab8728ecbb37648c7 (127.16.188.193:44847)
W20260809 19:01:25.325819 16627 tablet.cc:2369] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:25.326062 16838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.319735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.194:43899 (local address 127.16.188.195:59657)
0809 19:01:25.320040 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:25.320061 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:25.320216 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:25.320649 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:25.320653 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:25.320685 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:25.320883 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.320895 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.322086 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.322090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.324049 (+ 1959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.324064 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.325339 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.325344 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.325489 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.325524 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 19:01:25.325619 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 19:01:25.325753 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":1}
I20260809 19:01:25.326071 16852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.319958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:59657 (local address 127.16.188.194:43899)
0809 19:01:25.320143 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.320148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.320169 (+ 21us) server_negotiation.cc:407] Connection header received
0809 19:01:25.320390 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.320397 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.320490 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.320593 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:25.321036 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.321956 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.324219 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.325206 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.325350 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.325419 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.325651 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.325785 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:01:25.326730 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.319995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.188.195:49355 (local address 127.16.188.193:44847)
0809 19:01:25.320244 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.320250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.320790 (+ 540us) server_negotiation.cc:407] Connection header received
0809 19:01:25.320942 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.320946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.321016 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.321136 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 19:01:25.321590 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.322448 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.324626 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.325740 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.325881 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.325945 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.326432 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.326547 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260809 19:01:25.327358 16876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.319991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.193:44847 (local address 127.16.188.195:49355)
0809 19:01:25.320681 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0809 19:01:25.320697 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:01:25.320824 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:01:25.321158 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:01:25.321161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:01:25.321183 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 19:01:25.321456 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.321464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.322589 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.322594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.324463 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:01:25.324473 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.326055 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.326062 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:01:25.326233 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.326277 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 19:01:25.326907 (+ 630us) client_negotiation.cc:240] Negotiation successful
0809 19:01:25.327027 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":1,"thread_start_us":372,"threads_started":1}
I20260809 19:01:25.327188 16562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ace46739a0469d889df44071d08517" candidate_uuid: "5c8008761d8d4d1dbc13c4990b43446a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" is_pre_election: true
I20260809 19:01:25.327706 16562 raft_consensus.cc:2454] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8008761d8d4d1dbc13c4990b43446a in term 0.
I20260809 19:01:25.328377 16654 leader_election.cc:302] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a8977215b0b4754beaea8fc19b0b8e5, 5c8008761d8d4d1dbc13c4990b43446a; no voters:
I20260809 19:01:25.328322 16363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ace46739a0469d889df44071d08517" candidate_uuid: "5c8008761d8d4d1dbc13c4990b43446a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca0927de533400ab8728ecbb37648c7" is_pre_election: true
I20260809 19:01:25.328758 16874 raft_consensus.cc:2781] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 19:01:25.328891 16874 raft_consensus.cc:482] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 19:01:25.328850 16363 raft_consensus.cc:2454] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8008761d8d4d1dbc13c4990b43446a in term 0.
I20260809 19:01:25.328989 16874 raft_consensus.cc:3037] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:25.331437 16874 raft_consensus.cc:504] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.331971 16874 leader_election.cc:288] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [CANDIDATE]: Term 1 election: Requested vote from peers 3a8977215b0b4754beaea8fc19b0b8e5 (127.16.188.194:43899), 8ca0927de533400ab8728ecbb37648c7 (127.16.188.193:44847)
I20260809 19:01:25.332366 16562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ace46739a0469d889df44071d08517" candidate_uuid: "5c8008761d8d4d1dbc13c4990b43446a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a8977215b0b4754beaea8fc19b0b8e5"
I20260809 19:01:25.332407 16363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ace46739a0469d889df44071d08517" candidate_uuid: "5c8008761d8d4d1dbc13c4990b43446a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca0927de533400ab8728ecbb37648c7"
I20260809 19:01:25.332523 16562 raft_consensus.cc:3037] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:25.332571 16363 raft_consensus.cc:3037] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:25.334630 16562 raft_consensus.cc:2454] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8008761d8d4d1dbc13c4990b43446a in term 1.
I20260809 19:01:25.334707 16363 raft_consensus.cc:2454] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8008761d8d4d1dbc13c4990b43446a in term 1.
I20260809 19:01:25.334995 16654 leader_election.cc:302] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a8977215b0b4754beaea8fc19b0b8e5, 5c8008761d8d4d1dbc13c4990b43446a; no voters:
I20260809 19:01:25.335260 16874 raft_consensus.cc:2781] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:25.335659 16874 raft_consensus.cc:686] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 1 LEADER]: Becoming Leader. State: Replica: 5c8008761d8d4d1dbc13c4990b43446a, State: Running, Role: LEADER
I20260809 19:01:25.336153 16874 consensus_queue.cc:237] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } }
I20260809 19:01:25.340454 16134 catalog_manager.cc:5495] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c8008761d8d4d1dbc13c4990b43446a (127.16.188.195). New cstate: current_term: 1 leader_uuid: "5c8008761d8d4d1dbc13c4990b43446a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8008761d8d4d1dbc13c4990b43446a" member_type: VOTER last_known_addr { host: "127.16.188.195" port: 43347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 } health_report { overall_health: UNKNOWN } } }
W20260809 19:01:25.369663 16437 tablet.cc:2369] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:25.399195 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.393941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45614 (local address 127.16.188.195:43347)
0809 19:01:25.394148 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.394154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.394245 (+ 91us) server_negotiation.cc:407] Connection header received
0809 19:01:25.394469 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.394473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.394564 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.394696 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:01:25.395057 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.395796 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.397162 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.397562 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.397672 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.398149 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:01:25.398649 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:01:25.398793 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.398878 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.398958 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 19:01:25.407225 16562 raft_consensus.cc:1261] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 1 FOLLOWER]: Refusing update from remote peer 5c8008761d8d4d1dbc13c4990b43446a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:25.407253 16363 raft_consensus.cc:1261] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 1 FOLLOWER]: Refusing update from remote peer 5c8008761d8d4d1dbc13c4990b43446a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:01:25.408186 16877 consensus_queue.cc:1035] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a8977215b0b4754beaea8fc19b0b8e5" member_type: VOTER last_known_addr { host: "127.16.188.194" port: 43899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:25.408562 16874 consensus_queue.cc:1035] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca0927de533400ab8728ecbb37648c7" member_type: VOTER last_known_addr { host: "127.16.188.193" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:01:25.419090 16880 mvcc.cc:205] Tried to move back new op lower bound from 7316693341817495552 to 7316693341540876288. Current Snapshot: MvccSnapshot[applied={T|T < 7316693341817495552}]
I20260809 19:01:25.435137 16134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:25.435369 16134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 19:01:25.438783 16134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 227252ab419c497da11a4ccc61b72fe3: Sending DeleteTablet for 3 replicas of tablet 40ace46739a0469d889df44071d08517
I20260809 19:01:25.439899 16532 tablet_service.cc:1514] Processing DeleteTablet for tablet 40ace46739a0469d889df44071d08517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:25 UTC) from {username='slave'} at 127.0.0.1:36470
I20260809 19:01:25.439963 16728 tablet_service.cc:1514] Processing DeleteTablet for tablet 40ace46739a0469d889df44071d08517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:25 UTC) from {username='slave'} at 127.0.0.1:45610
I20260809 19:01:25.440583 16334 tablet_service.cc:1514] Processing DeleteTablet for tablet 40ace46739a0469d889df44071d08517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 19:01:25 UTC) from {username='slave'} at 127.0.0.1:43930
I20260809 19:01:25.440780 16897 tablet_replica.cc:330] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: stopping tablet replica
I20260809 19:01:25.441216 16897 raft_consensus.cc:2229] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:25.441609 16905 tablet_replica.cc:330] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: stopping tablet replica
I20260809 19:01:25.441711 16897 raft_consensus.cc:2258] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:25.442049 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 16232
I20260809 19:01:25.442215 16905 raft_consensus.cc:2229] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 19:01:25.442768 16905 raft_consensus.cc:2258] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:25.445353 16905 ts_tablet_manager.cc:1905] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:25.447198 16897 ts_tablet_manager.cc:1905] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:25.453401 16905 ts_tablet_manager.cc:1918] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:25.453670 16905 log.cc:1196] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-0/wal/wals/40ace46739a0469d889df44071d08517
I20260809 19:01:25.454330 16905 ts_tablet_manager.cc:1939] T 40ace46739a0469d889df44071d08517 P 8ca0927de533400ab8728ecbb37648c7: Deleting consensus metadata
I20260809 19:01:25.454437 16897 ts_tablet_manager.cc:1918] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:25.454612 16897 log.cc:1196] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-1/wal/wals/40ace46739a0469d889df44071d08517
I20260809 19:01:25.455159 16897 ts_tablet_manager.cc:1939] T 40ace46739a0469d889df44071d08517 P 3a8977215b0b4754beaea8fc19b0b8e5: Deleting consensus metadata
I20260809 19:01:25.456526 16116 catalog_manager.cc:4841] TS 8ca0927de533400ab8728ecbb37648c7 (127.16.188.193:44847): tablet 40ace46739a0469d889df44071d08517 (table test-table [id=628ceb33bb8a4e319fb65b7b64592cd8]) successfully deleted
I20260809 19:01:25.456862 16112 catalog_manager.cc:4841] TS 3a8977215b0b4754beaea8fc19b0b8e5 (127.16.188.194:43899): tablet 40ace46739a0469d889df44071d08517 (table test-table [id=628ceb33bb8a4e319fb65b7b64592cd8]) successfully deleted
I20260809 19:01:25.457767 16904 tablet_replica.cc:330] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: stopping tablet replica
I20260809 19:01:25.458158 16904 raft_consensus.cc:2229] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 1 LEADER]: Raft consensus shutting down.
I20260809 19:01:25.458814 16904 raft_consensus.cc:2258] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 19:01:25.460842 16904 ts_tablet_manager.cc:1905] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 19:01:25.464773 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.443536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43946 (local address 127.16.188.193:44847)
0809 19:01:25.443719 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.443724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.457103 (+ 13379us) server_negotiation.cc:407] Connection header received
0809 19:01:25.457330 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.457335 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.457446 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.457547 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:25.458112 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.459184 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.461041 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.461709 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.461846 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.463098 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:25.463110 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:25.463127 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:25.463876 (+ 749us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:25.463944 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:25.463971 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:25.464106 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.464265 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.464384 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 19:01:25.465483 16429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:25.469238 16904 ts_tablet_manager.cc:1918] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 19:01:25.469492 16904 log.cc:1196] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Deleting WAL directory at /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301765673554-17139-0/minicluster-data/ts-2/wal/wals/40ace46739a0469d889df44071d08517
I20260809 19:01:25.470132 16904 ts_tablet_manager.cc:1939] T 40ace46739a0469d889df44071d08517 P 5c8008761d8d4d1dbc13c4990b43446a: Deleting consensus metadata
I20260809 19:01:25.472072 16113 catalog_manager.cc:4841] TS 5c8008761d8d4d1dbc13c4990b43446a (127.16.188.195:43347): tablet 40ace46739a0469d889df44071d08517 (table test-table [id=628ceb33bb8a4e319fb65b7b64592cd8]) successfully deleted
I20260809 19:01:25.554100 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 16232
I20260809 19:01:25.581218 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 16440
I20260809 19:01:25.592067 16852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.582884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36480 (local address 127.16.188.194:43899)
0809 19:01:25.583078 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.583085 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.583109 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:01:25.583179 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.583185 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.583310 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.583430 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:25.584139 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.585394 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.587349 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.588087 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.588221 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.589780 (+ 1559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:25.589793 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:25.589812 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:25.590649 (+ 837us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:25.590725 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:25.590753 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:25.590873 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.591506 (+ 633us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.591638 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 19:01:25.593140 16619 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:25.683720 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 16440
I20260809 19:01:25.714100 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 16630
I20260809 19:01:25.722119 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:25.714996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45618 (local address 127.16.188.195:43347)
0809 19:01:25.715164 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:25.715169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:25.715306 (+ 137us) server_negotiation.cc:407] Connection header received
0809 19:01:25.715519 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:25.715523 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:25.715608 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:25.715699 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:25.716238 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.717068 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.718973 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:25.719427 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:25.719523 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:25.720704 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:25.720713 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:25.720726 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:25.721342 (+ 616us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:25.721391 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:25.721411 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:25.721492 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:25.721685 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 19:01:25.721773 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 19:01:25.722795 16827 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:25.838750 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 16630
I20260809 19:01:25.866094 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 16074
I20260809 19:01:25.867187 16185 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:25.972932 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 16074
2026-08-09T19:01:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2912 ms)
[----------] 6 tests from EncryptionPolicyTest (22030 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:26 dist-test-slave-266d krb5kdc[16919](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:26 dist-test-slave-266d krb5kdc[16919](info): set up 2 sockets
Aug 09 19:01:26 dist-test-slave-266d krb5kdc[16919](info): commencing operation
krb5kdc: starting...
W20260809 19:01:27.209124 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.002s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:27 dist-test-slave-266d krb5kdc[16919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:27.484236 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34259
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34259
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:27.816275 16937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:27.816594 16937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:27.816737 16937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:27.823753 16937 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:27.823870 16937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:27.823946 16937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:27.824026 16937 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:27.824082 16937 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:27.833629 16937 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34259
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:27.834896 16937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:27.836166 16937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:27.850193 16952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:27.850267 16950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:27.850248 16948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:27.851145 16937 server_base.cc:1034] running on GCE node
I20260809 19:01:27.851879 16937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:27.853242 16937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:27.854439 16937 hybrid_clock.cc:648] HybridClock initialized: now 1786302087854401 us; error 30 us; skew 500 ppm
I20260809 19:01:27.854794 16937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:27 dist-test-slave-266d krb5kdc[16919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302087, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:27.857946 16937 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:27.859380 16937 webserver.cc:460] Webserver started at http://127.0.0.1:43929/ using document root <none> and password file <none>
I20260809 19:01:27.860025 16937 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:27.860141 16937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:27.860435 16937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:27.863400 16937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "d0ce328f495742e6b4be26a83147ddc3"
format_stamp: "Formatted at 2026-08-09 19:01:27 on dist-test-slave-266d"
server_key: "626d38c89305149b217856d989c224a8"
server_key_iv: "06d32cff324329286f0b9845d2f1a56f"
server_key_version: "encryptionkey@0"
I20260809 19:01:27.864169 16937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "d0ce328f495742e6b4be26a83147ddc3"
format_stamp: "Formatted at 2026-08-09 19:01:27 on dist-test-slave-266d"
server_key: "626d38c89305149b217856d989c224a8"
server_key_iv: "06d32cff324329286f0b9845d2f1a56f"
server_key_version: "encryptionkey@0"
I20260809 19:01:27.869257 16937 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 19:01:27.872685 16961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:27.874058 16937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:27.874235 16937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "d0ce328f495742e6b4be26a83147ddc3"
format_stamp: "Formatted at 2026-08-09 19:01:27 on dist-test-slave-266d"
server_key: "626d38c89305149b217856d989c224a8"
server_key_iv: "06d32cff324329286f0b9845d2f1a56f"
server_key_version: "encryptionkey@0"
I20260809 19:01:27.874454 16937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:27.888020 16937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:27.891845 16937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:27.892105 16937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:27.909350 16937 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34259
I20260809 19:01:27.909382 17040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34259 every 8 connection(s)
I20260809 19:01:27.910710 16937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:27.914436 17041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:27.918720 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 16937
I20260809 19:01:27.918942 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:27.919806 17139 external_mini_cluster.cc:1428] Setting key 484712e2b92f3eb10b527cf3a3e80e82
I20260809 19:01:27.925832 17041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3: Bootstrap starting.
I20260809 19:01:27.929374 17041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:27.930557 17041 log.cc:824] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:27.933887 17041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3: No bootstrap required, opened a new log
Aug 09 19:01:27 dist-test-slave-266d krb5kdc[16919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:01:27.944418 17046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:27.921706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34477 (local address 127.0.0.1:34259)
0809 19:01:27.922493 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:27.922504 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:27.922547 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:01:27.924304 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:27.924327 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:27.924703 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:27.925003 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:27.926930 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:27.928271 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:27.930060 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:27.930780 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:27.930918 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:27.935627 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:27.935637 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:27.935660 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:27.935717 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:27.939725 (+ 4008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:27.940564 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:27.940573 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:27.940582 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:27.940823 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:27.941260 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:27.941265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:27.941269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:27.941999 (+ 730us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:27.942349 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:27.942685 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 19:01:27.943059 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":355,"threads_started":1}
I20260809 19:01:27.944340 17041 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce328f495742e6b4be26a83147ddc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34259 } }
I20260809 19:01:27.944798 17041 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:27.944890 17041 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ce328f495742e6b4be26a83147ddc3, State: Initialized, Role: FOLLOWER
I20260809 19:01:27.945465 17041 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce328f495742e6b4be26a83147ddc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34259 } }
I20260809 19:01:27.945703 17041 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:27.945851 17041 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:27.946070 17041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:27.948639 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:27.948938 17041 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce328f495742e6b4be26a83147ddc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34259 } }
I20260809 19:01:27.949501 17041 leader_election.cc:302] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0ce328f495742e6b4be26a83147ddc3; no voters:
I20260809 19:01:27.950104 17041 leader_election.cc:288] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:27.950234 17048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:27.951334 17048 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [term 1 LEADER]: Becoming Leader. State: Replica: d0ce328f495742e6b4be26a83147ddc3, State: Running, Role: LEADER
I20260809 19:01:27.951826 17048 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce328f495742e6b4be26a83147ddc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34259 } }
I20260809 19:01:27.952318 17041 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:27.958458 17050 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0ce328f495742e6b4be26a83147ddc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce328f495742e6b4be26a83147ddc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34259 } } }
I20260809 19:01:27.958817 17050 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:27.959306 17051 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ce328f495742e6b4be26a83147ddc3. Latest consensus state: current_term: 1 leader_uuid: "d0ce328f495742e6b4be26a83147ddc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce328f495742e6b4be26a83147ddc3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34259 } } }
I20260809 19:01:27.959589 17051 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:27.963122 17063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:27.972571 17063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:27.973850 17046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:27.954607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48093 (local address 127.0.0.1:34259)
0809 19:01:27.954781 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:27.954788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:27.955358 (+ 570us) server_negotiation.cc:407] Connection header received
0809 19:01:27.955622 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:27.955629 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:27.955721 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:27.955824 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:27.957739 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:27.959030 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:27.960952 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:27.961647 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:27.961743 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:27.965521 (+ 3778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:27.965528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:27.965534 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:27.965577 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:27.969363 (+ 3786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:27.970395 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:27.970401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:27.970405 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:27.970582 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:27.971195 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:27.971200 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:27.971204 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:27.971675 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:27.973125 (+ 1450us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:27.973313 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 19:01:27.973498 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:01:27.982407 17063 catalog_manager.cc:1347] Generated new cluster ID: f4087820b3314cf8b49e20fdb7663bff
I20260809 19:01:27.982512 17063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:27.995219 17063 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:27.997008 17063 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:28.014246 17063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0ce328f495742e6b4be26a83147ddc3: Generated new TSK 0
I20260809 19:01:28.015431 17063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:28.025367 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 16937
I20260809 19:01:28.027411 17035 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:28.117499 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 16937
W20260809 19:01:28.141448 16917 connection.cc:535] client connection to 127.0.0.1:34259 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34259): Connection reset by peer (error 104)
2026-08-09T19:01:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2138 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:28 dist-test-slave-266d krb5kdc[17084](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:28 dist-test-slave-266d krb5kdc[17084](info): set up 2 sockets
Aug 09 19:01:28 dist-test-slave-266d krb5kdc[17084](info): commencing operation
krb5kdc: starting...
W20260809 19:01:29.335873 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.004s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:29 dist-test-slave-266d krb5kdc[17084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:29.613905 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:29.947527 17103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:29.947788 17103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:29.947925 17103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:29.954917 17103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:29.955018 17103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:29.955094 17103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:29.955174 17103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:29.955235 17103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:29.964619 17103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44353
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:29.965778 17103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:29.966969 17103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:29.978096 17118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:29.978170 17114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:29.978147 17115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:29.978827 17103 server_base.cc:1034] running on GCE node
I20260809 19:01:29.979533 17103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:29.980830 17103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:29.982023 17103 hybrid_clock.cc:648] HybridClock initialized: now 1786302089981987 us; error 25 us; skew 500 ppm
I20260809 19:01:29.982335 17103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:29 dist-test-slave-266d krb5kdc[17084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302089, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:29.989746 17103 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:29.991061 17103 webserver.cc:460] Webserver started at http://127.0.0.1:46055/ using document root <none> and password file <none>
I20260809 19:01:29.991654 17103 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:29.991756 17103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:29.991997 17103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:29.994786 17103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "620ff4d7e2cc49fd82c5e20115eefc1e"
format_stamp: "Formatted at 2026-08-09 19:01:29 on dist-test-slave-266d"
server_key: "7553d34a205c1bb25846a052f22a80a4"
server_key_iv: "fa02e54c3e939803ca009eed8b43c48c"
server_key_version: "encryptionkey@0"
I20260809 19:01:29.995467 17103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "620ff4d7e2cc49fd82c5e20115eefc1e"
format_stamp: "Formatted at 2026-08-09 19:01:29 on dist-test-slave-266d"
server_key: "7553d34a205c1bb25846a052f22a80a4"
server_key_iv: "fa02e54c3e939803ca009eed8b43c48c"
server_key_version: "encryptionkey@0"
I20260809 19:01:30.000241 17103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 19:01:30.003511 17126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:30.004729 17103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:01:30.004881 17103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "620ff4d7e2cc49fd82c5e20115eefc1e"
format_stamp: "Formatted at 2026-08-09 19:01:29 on dist-test-slave-266d"
server_key: "7553d34a205c1bb25846a052f22a80a4"
server_key_iv: "fa02e54c3e939803ca009eed8b43c48c"
server_key_version: "encryptionkey@0"
I20260809 19:01:30.005051 17103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:30.030088 17103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:30.034113 17103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:30.034374 17103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:30.051108 17103 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44353
I20260809 19:01:30.051141 17225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44353 every 8 connection(s)
I20260809 19:01:30.052378 17103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:30.055883 17227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:30.061707 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17103
I20260809 19:01:30.061877 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:30.062309 17139 external_mini_cluster.cc:1428] Setting key 5f79f9600a763198726c8a78d800aa8e
I20260809 19:01:30.065912 17227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e: Bootstrap starting.
I20260809 19:01:30.069031 17227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:30.070232 17227 log.cc:824] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:30.073421 17227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e: No bootstrap required, opened a new log
I20260809 19:01:30.075573 17235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:30.063920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54965 (local address 127.0.0.1:44353)
0809 19:01:30.064667 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:30.064678 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:30.064717 (+ 39us) server_negotiation.cc:407] Connection header received
0809 19:01:30.066385 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:30.066408 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:30.066765 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:30.067051 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:30.067682 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:30.068916 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:30.070708 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:30.071795 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:30.071960 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:30.073226 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:30.073235 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:30.073248 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:30.073838 (+ 590us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:30.073931 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:30.073961 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:30.074102 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:30.074352 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 19:01:30.074523 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":342,"threads_started":1}
I20260809 19:01:30.079487 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:30.082448 17227 raft_consensus.cc:348] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "620ff4d7e2cc49fd82c5e20115eefc1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } }
I20260809 19:01:30.082908 17227 raft_consensus.cc:374] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:30.083012 17227 raft_consensus.cc:729] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620ff4d7e2cc49fd82c5e20115eefc1e, State: Initialized, Role: FOLLOWER
I20260809 19:01:30.083626 17227 consensus_queue.cc:260] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "620ff4d7e2cc49fd82c5e20115eefc1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } }
I20260809 19:01:30.083911 17227 raft_consensus.cc:388] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:30.084049 17227 raft_consensus.cc:482] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:30.084210 17227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:30.087178 17227 raft_consensus.cc:504] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "620ff4d7e2cc49fd82c5e20115eefc1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } }
I20260809 19:01:30.087615 17227 leader_election.cc:302] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 620ff4d7e2cc49fd82c5e20115eefc1e; no voters:
I20260809 19:01:30.088243 17227 leader_election.cc:288] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:30.088346 17244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:30.089583 17244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [term 1 LEADER]: Becoming Leader. State: Replica: 620ff4d7e2cc49fd82c5e20115eefc1e, State: Running, Role: LEADER
I20260809 19:01:30.090209 17244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "620ff4d7e2cc49fd82c5e20115eefc1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } }
I20260809 19:01:30.090468 17227 sys_catalog.cc:564] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:30.091073 17235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:30.084498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35499 (local address 127.0.0.1:44353)
0809 19:01:30.084661 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:30.084666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:30.085190 (+ 524us) server_negotiation.cc:407] Connection header received
0809 19:01:30.085344 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:30.085349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:30.085420 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:30.085520 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:30.085953 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:30.087002 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:30.088342 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:30.089024 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:30.089171 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:30.090360 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:30.090364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:30.090368 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:30.090384 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:30.090443 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:30.090468 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:30.090574 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:30.090751 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 19:01:30.090801 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:01:30.093883 17245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "620ff4d7e2cc49fd82c5e20115eefc1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "620ff4d7e2cc49fd82c5e20115eefc1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } } }
I20260809 19:01:30.094311 17245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:30.093919 17248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 620ff4d7e2cc49fd82c5e20115eefc1e. Latest consensus state: current_term: 1 leader_uuid: "620ff4d7e2cc49fd82c5e20115eefc1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "620ff4d7e2cc49fd82c5e20115eefc1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44353 } } }
I20260809 19:01:30.094847 17248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:30.095108 17254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:30.100517 17254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:30.108997 17254 catalog_manager.cc:1347] Generated new cluster ID: 4671c120a44b40ada72ccb4eb32d07cd
I20260809 19:01:30.109115 17254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:30.130390 17254 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:30.132171 17254 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:30.142453 17254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 620ff4d7e2cc49fd82c5e20115eefc1e: Generated new TSK 0
I20260809 19:01:30.143399 17254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:30.148909 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17103
W20260809 19:01:30.149991 17220 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54965
W20260809 19:01:30.150692 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17103: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:30.150852 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17103
W20260809 19:01:30.179436 17082 connection.cc:535] client connection to 127.0.0.1:44353 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44353): Connection reset by peer (error 104)
2026-08-09T19:01:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2038 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:30 dist-test-slave-266d krb5kdc[17270](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:30 dist-test-slave-266d krb5kdc[17270](info): set up 2 sockets
Aug 09 19:01:30 dist-test-slave-266d krb5kdc[17270](info): commencing operation
krb5kdc: starting...
W20260809 19:01:31.382529 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:31 dist-test-slave-266d krb5kdc[17270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:31.665403 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:31.994169 17288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:31.994449 17288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:31.994581 17288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:32.002620 17288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:32.002748 17288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:32.002843 17288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:32.002928 17288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:32.002988 17288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:32.012851 17288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:32.014139 17288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:32.015411 17288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:32.026902 17294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:32.026897 17293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:32.027259 17297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:32.027683 17288 server_base.cc:1034] running on GCE node
I20260809 19:01:32.028411 17288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:32.029726 17288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:32.030936 17288 hybrid_clock.cc:648] HybridClock initialized: now 1786302092030892 us; error 23 us; skew 500 ppm
I20260809 19:01:32.031263 17288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:32 dist-test-slave-266d krb5kdc[17270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302092, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:32.034250 17288 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:32.035578 17288 webserver.cc:460] Webserver started at http://127.0.0.1:42373/ using document root <none> and password file <none>
I20260809 19:01:32.036213 17288 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:32.036343 17288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:32.036633 17288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:32.039541 17288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "c5343c9ad7e34dc4acba406e4683242f"
format_stamp: "Formatted at 2026-08-09 19:01:32 on dist-test-slave-266d"
server_key: "4eea30ac28e84612fa5ce760aad84916"
server_key_iv: "4e2e0e9aa1c93075c86b2feff89531cc"
server_key_version: "encryptionkey@0"
I20260809 19:01:32.040309 17288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "c5343c9ad7e34dc4acba406e4683242f"
format_stamp: "Formatted at 2026-08-09 19:01:32 on dist-test-slave-266d"
server_key: "4eea30ac28e84612fa5ce760aad84916"
server_key_iv: "4e2e0e9aa1c93075c86b2feff89531cc"
server_key_version: "encryptionkey@0"
I20260809 19:01:32.045334 17288 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260809 19:01:32.048543 17311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:32.049803 17288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:32.049961 17288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "c5343c9ad7e34dc4acba406e4683242f"
format_stamp: "Formatted at 2026-08-09 19:01:32 on dist-test-slave-266d"
server_key: "4eea30ac28e84612fa5ce760aad84916"
server_key_iv: "4e2e0e9aa1c93075c86b2feff89531cc"
server_key_version: "encryptionkey@0"
I20260809 19:01:32.050145 17288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:32.055434 17288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:32.059427 17288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:32.059693 17288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:32.077450 17288 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37145
I20260809 19:01:32.077492 17383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37145 every 8 connection(s)
I20260809 19:01:32.078955 17288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:32.082252 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17288
I20260809 19:01:32.082435 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:32.083021 17139 external_mini_cluster.cc:1428] Setting key 64c01a8602c26c38d076cd4a80f2633c
I20260809 19:01:32.083293 17384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:32.091743 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:32.084933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36131 (local address 127.0.0.1:37145)
0809 19:01:32.085794 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:32.085807 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:32.085849 (+ 42us) server_negotiation.cc:407] Connection header received
0809 19:01:32.088165 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:32.088190 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:32.088563 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:32.088993 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:32.090081 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:32.090087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:32.090100 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:32.090128 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:32.090195 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:32.090216 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:32.090442 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:32.090591 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 19:01:32.090782 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":348,"threads_started":1}
I20260809 19:01:32.095423 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:32.096585 17384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f: Bootstrap starting.
I20260809 19:01:32.100054 17384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:32.101377 17384 log.cc:824] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:32.102078 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:32.099538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49937 (local address 127.0.0.1:37145)
0809 19:01:32.099681 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:32.099686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:32.100174 (+ 488us) server_negotiation.cc:407] Connection header received
0809 19:01:32.100335 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:32.100340 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:32.100411 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:32.100524 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:32.101401 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:32.101407 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:32.101411 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:32.101431 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:32.101478 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:32.101498 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:32.101612 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:32.101706 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 19:01:32.101773 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 19:01:32.104228 17384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f: No bootstrap required, opened a new log
I20260809 19:01:32.111233 17384 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5343c9ad7e34dc4acba406e4683242f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37145 } }
I20260809 19:01:32.111588 17384 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:32.111663 17384 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5343c9ad7e34dc4acba406e4683242f, State: Initialized, Role: FOLLOWER
I20260809 19:01:32.112187 17384 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5343c9ad7e34dc4acba406e4683242f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37145 } }
I20260809 19:01:32.112401 17384 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:32.112500 17384 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:32.112625 17384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:32.114943 17384 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5343c9ad7e34dc4acba406e4683242f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37145 } }
I20260809 19:01:32.115404 17384 leader_election.cc:302] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5343c9ad7e34dc4acba406e4683242f; no voters:
I20260809 19:01:32.115970 17384 leader_election.cc:288] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:32.116122 17399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:32.116798 17399 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [term 1 LEADER]: Becoming Leader. State: Replica: c5343c9ad7e34dc4acba406e4683242f, State: Running, Role: LEADER
I20260809 19:01:32.117373 17399 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5343c9ad7e34dc4acba406e4683242f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37145 } }
I20260809 19:01:32.117920 17384 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:32.120388 17405 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5343c9ad7e34dc4acba406e4683242f. Latest consensus state: current_term: 1 leader_uuid: "c5343c9ad7e34dc4acba406e4683242f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5343c9ad7e34dc4acba406e4683242f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37145 } } }
I20260809 19:01:32.120859 17405 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:32.120710 17404 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5343c9ad7e34dc4acba406e4683242f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5343c9ad7e34dc4acba406e4683242f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37145 } } }
I20260809 19:01:32.121011 17404 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:32.124253 17414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:32.129505 17414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:32.138586 17414 catalog_manager.cc:1347] Generated new cluster ID: 43f7061cba7e4e7daadc884a34abc169
I20260809 19:01:32.138685 17414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:32.150003 17414 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:32.150383 17414 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:32.163681 17414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5343c9ad7e34dc4acba406e4683242f: Generated new TSK 0
I20260809 19:01:32.164518 17414 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:32.174220 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17288
W20260809 19:01:32.175611 17377 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36131
W20260809 19:01:32.176239 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17288: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:32.176414 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17288
2026-08-09T19:01:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2024 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:32 dist-test-slave-266d krb5kdc[17431](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:32 dist-test-slave-266d krb5kdc[17431](info): set up 2 sockets
Aug 09 19:01:32 dist-test-slave-266d krb5kdc[17431](info): commencing operation
krb5kdc: starting...
W20260809 19:01:33.416165 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.004s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:33 dist-test-slave-266d krb5kdc[17431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:33.707918 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34603
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:34.043150 17452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:34.043437 17452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:34.043572 17452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:34.050645 17452 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:34.050767 17452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:34.050844 17452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:34.050931 17452 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:34.050987 17452 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:34.060422 17452 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:34.061708 17452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:34.062976 17452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:34.074072 17463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:34.074420 17465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:34.074604 17461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:34.074878 17452 server_base.cc:1034] running on GCE node
I20260809 19:01:34.075659 17452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:34.077003 17452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:34.078205 17452 hybrid_clock.cc:648] HybridClock initialized: now 1786302094078154 us; error 39 us; skew 500 ppm
I20260809 19:01:34.078517 17452 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:34 dist-test-slave-266d krb5kdc[17431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302094, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:34.081568 17452 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:34.082935 17452 webserver.cc:460] Webserver started at http://127.0.0.1:42767/ using document root <none> and password file <none>
I20260809 19:01:34.083551 17452 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:34.083660 17452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:34.083914 17452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:34.086845 17452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "dc2f35d3e31e486b9019a36384d3a845"
format_stamp: "Formatted at 2026-08-09 19:01:34 on dist-test-slave-266d"
server_key: "b909d2a9caeaf51e6c658f1eb43b4594"
server_key_iv: "dd9ee4a015f1d1e6a0653201ee6210c0"
server_key_version: "encryptionkey@0"
I20260809 19:01:34.087563 17452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "dc2f35d3e31e486b9019a36384d3a845"
format_stamp: "Formatted at 2026-08-09 19:01:34 on dist-test-slave-266d"
server_key: "b909d2a9caeaf51e6c658f1eb43b4594"
server_key_iv: "dd9ee4a015f1d1e6a0653201ee6210c0"
server_key_version: "encryptionkey@0"
I20260809 19:01:34.092424 17452 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:01:34.095764 17477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:34.096985 17452 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:01:34.097184 17452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "dc2f35d3e31e486b9019a36384d3a845"
format_stamp: "Formatted at 2026-08-09 19:01:34 on dist-test-slave-266d"
server_key: "b909d2a9caeaf51e6c658f1eb43b4594"
server_key_iv: "dd9ee4a015f1d1e6a0653201ee6210c0"
server_key_version: "encryptionkey@0"
I20260809 19:01:34.097349 17452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:34.116845 17452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:34.120486 17452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:34.120721 17452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:34.137988 17452 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34603
I20260809 19:01:34.138020 17550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34603 every 8 connection(s)
I20260809 19:01:34.139269 17452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:34.142823 17551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:34.145257 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17452
I20260809 19:01:34.145448 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:34.145994 17139 external_mini_cluster.cc:1428] Setting key 9323f883e0c0df34464fa5349e116fbe
I20260809 19:01:34.154568 17551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845: Bootstrap starting.
I20260809 19:01:34.158140 17551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:34.159416 17551 log.cc:824] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845: Log is configured to *not* fsync() on all Append() calls
Aug 09 19:01:34 dist-test-slave-266d krb5kdc[17431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:01:34.162184 17551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845: No bootstrap required, opened a new log
I20260809 19:01:34.168217 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:34.147757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50293 (local address 127.0.0.1:34603)
0809 19:01:34.148564 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:34.148575 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:34.148618 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:01:34.150287 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:34.150308 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:34.150667 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:34.150973 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:34.152668 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:34.153959 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:34.155701 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:34.156374 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:34.156497 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:34.161249 (+ 4752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:34.161256 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:34.161269 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:34.161304 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:34.164223 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:34.164910 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:34.164916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:34.164922 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:34.165124 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:34.165513 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:34.165519 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:34.165522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:34.166029 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:34.166344 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:34.166785 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 19:01:34.167205 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":355,"threads_started":1}
I20260809 19:01:34.170024 17551 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc2f35d3e31e486b9019a36384d3a845" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34603 } }
I20260809 19:01:34.170461 17551 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:34.170578 17551 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc2f35d3e31e486b9019a36384d3a845, State: Initialized, Role: FOLLOWER
I20260809 19:01:34.171208 17551 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc2f35d3e31e486b9019a36384d3a845" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34603 } }
I20260809 19:01:34.171486 17551 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:34.171635 17551 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:34.171815 17551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:34.172101 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:34.174345 17551 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc2f35d3e31e486b9019a36384d3a845" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34603 } }
I20260809 19:01:34.174986 17551 leader_election.cc:302] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc2f35d3e31e486b9019a36384d3a845; no voters:
I20260809 19:01:34.175726 17551 leader_election.cc:288] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:34.175823 17567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:34.178243 17551 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:34.181480 17567 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [term 1 LEADER]: Becoming Leader. State: Replica: dc2f35d3e31e486b9019a36384d3a845, State: Running, Role: LEADER
I20260809 19:01:34.182281 17567 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc2f35d3e31e486b9019a36384d3a845" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34603 } }
I20260809 19:01:34.185182 17568 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc2f35d3e31e486b9019a36384d3a845" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc2f35d3e31e486b9019a36384d3a845" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34603 } } }
I20260809 19:01:34.185644 17568 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:34.186187 17570 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc2f35d3e31e486b9019a36384d3a845. Latest consensus state: current_term: 1 leader_uuid: "dc2f35d3e31e486b9019a36384d3a845" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc2f35d3e31e486b9019a36384d3a845" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34603 } } }
I20260809 19:01:34.187016 17570 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:34.186550 17586 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:34.192632 17586 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:34.198516 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:34.176948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47181 (local address 127.0.0.1:34603)
0809 19:01:34.177146 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:34.177153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:34.180189 (+ 3036us) server_negotiation.cc:407] Connection header received
0809 19:01:34.180396 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:34.180399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:34.180459 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:34.180553 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:34.182463 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:34.183273 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:34.184738 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:34.185636 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:34.185818 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:34.189562 (+ 3744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:34.189571 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:34.189577 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:34.189628 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:34.193903 (+ 4275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:34.194891 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:34.194900 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:34.194904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:34.195099 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:34.195652 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:34.195658 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:34.195662 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:34.196168 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:34.196456 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:34.197784 (+ 1328us) server_negotiation.cc:299] Negotiation successful
0809 19:01:34.198038 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:01:34.208951 17586 catalog_manager.cc:1347] Generated new cluster ID: ed67a1cb98384a1fabb3bd7ac56a5b56
I20260809 19:01:34.209070 17586 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:34.228667 17586 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:34.229982 17586 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:34.239962 17586 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc2f35d3e31e486b9019a36384d3a845: Generated new TSK 0
I20260809 19:01:34.240731 17586 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:34.247793 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17452
I20260809 19:01:34.249023 17544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:34.338316 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17452
2026-08-09T19:01:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2159 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:34 dist-test-slave-266d krb5kdc[17605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:34 dist-test-slave-266d krb5kdc[17605](info): set up 2 sockets
Aug 09 19:01:34 dist-test-slave-266d krb5kdc[17605](info): commencing operation
krb5kdc: starting...
W20260809 19:01:35.556578 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:35 dist-test-slave-266d krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:35.826476 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34965
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:36.155014 17625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:36.155289 17625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:36.155387 17625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:36.162303 17625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:36.162400 17625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:36.162451 17625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:36.162509 17625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:36.162552 17625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:36.171846 17625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:36.172977 17625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:36.174208 17625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:36.185164 17633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:36.185251 17632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:36.185176 17636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:36.185868 17625 server_base.cc:1034] running on GCE node
I20260809 19:01:36.186606 17625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:36.187920 17625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:36.189152 17625 hybrid_clock.cc:648] HybridClock initialized: now 1786302096189094 us; error 45 us; skew 500 ppm
I20260809 19:01:36.189481 17625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:36 dist-test-slave-266d krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302096, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:36.195168 17625 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:36.196498 17625 webserver.cc:460] Webserver started at http://127.0.0.1:32785/ using document root <none> and password file <none>
I20260809 19:01:36.197163 17625 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:36.197273 17625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:36.197525 17625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:36.200362 17625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "8dac30f54afd4e9f8322e58b93639367"
format_stamp: "Formatted at 2026-08-09 19:01:36 on dist-test-slave-266d"
server_key: "4059d83404e03d5d65b192d2142967a4"
server_key_iv: "0678c66c2e8b24951d9f487679223dc2"
server_key_version: "encryptionkey@0"
I20260809 19:01:36.201056 17625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "8dac30f54afd4e9f8322e58b93639367"
format_stamp: "Formatted at 2026-08-09 19:01:36 on dist-test-slave-266d"
server_key: "4059d83404e03d5d65b192d2142967a4"
server_key_iv: "0678c66c2e8b24951d9f487679223dc2"
server_key_version: "encryptionkey@0"
I20260809 19:01:36.205816 17625 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 19:01:36.208910 17647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:36.210111 17625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 19:01:36.210253 17625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "8dac30f54afd4e9f8322e58b93639367"
format_stamp: "Formatted at 2026-08-09 19:01:36 on dist-test-slave-266d"
server_key: "4059d83404e03d5d65b192d2142967a4"
server_key_iv: "0678c66c2e8b24951d9f487679223dc2"
server_key_version: "encryptionkey@0"
I20260809 19:01:36.210399 17625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:36.228057 17625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:36.232398 17625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:36.232664 17625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:36.250959 17625 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34965
I20260809 19:01:36.250976 17722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34965 every 8 connection(s)
I20260809 19:01:36.252347 17625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:36.255908 17723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:36.261428 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17625
I20260809 19:01:36.261617 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:36.262084 17139 external_mini_cluster.cc:1428] Setting key 6a73f21e2eca17774f9bb8f83e034d8e
I20260809 19:01:36.266142 17723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367: Bootstrap starting.
I20260809 19:01:36.269335 17723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:36.270535 17723 log.cc:824] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:36.273507 17723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367: No bootstrap required, opened a new log
I20260809 19:01:36.275342 17726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:36.263914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54253 (local address 127.0.0.1:34965)
0809 19:01:36.264787 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:36.264798 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:36.264842 (+ 44us) server_negotiation.cc:407] Connection header received
0809 19:01:36.266686 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:36.266711 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:36.267096 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:36.267426 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:36.268068 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:36.269449 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:36.271252 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:36.271917 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:36.272079 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:36.273221 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:36.273228 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:36.273241 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:36.273768 (+ 527us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:36.273848 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:36.273876 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:36.273996 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:36.274193 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 19:01:36.274434 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":407,"threads_started":1}
I20260809 19:01:36.279187 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:36.282166 17723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dac30f54afd4e9f8322e58b93639367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260809 19:01:36.282511 17723 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:36.282641 17723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dac30f54afd4e9f8322e58b93639367, State: Initialized, Role: FOLLOWER
I20260809 19:01:36.283210 17723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dac30f54afd4e9f8322e58b93639367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260809 19:01:36.283586 17723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:36.283746 17723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:36.283973 17723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:36.287220 17723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dac30f54afd4e9f8322e58b93639367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260809 19:01:36.287801 17723 leader_election.cc:302] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dac30f54afd4e9f8322e58b93639367; no voters:
I20260809 19:01:36.288410 17723 leader_election.cc:288] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:36.288506 17739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:36.289697 17739 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [term 1 LEADER]: Becoming Leader. State: Replica: 8dac30f54afd4e9f8322e58b93639367, State: Running, Role: LEADER
I20260809 19:01:36.290346 17726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:36.283383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55371 (local address 127.0.0.1:34965)
0809 19:01:36.283546 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:36.283551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:36.283908 (+ 357us) server_negotiation.cc:407] Connection header received
0809 19:01:36.284163 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:36.284167 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:36.284224 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:36.284314 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:36.284952 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:36.285751 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:36.287637 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:36.288139 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:36.288282 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:36.289486 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:36.289493 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:36.289501 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:36.289521 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:36.289565 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:36.289587 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:36.289652 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:36.289904 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 19:01:36.289991 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:01:36.290256 17739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dac30f54afd4e9f8322e58b93639367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260809 19:01:36.290737 17723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:36.292891 17741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dac30f54afd4e9f8322e58b93639367. Latest consensus state: current_term: 1 leader_uuid: "8dac30f54afd4e9f8322e58b93639367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dac30f54afd4e9f8322e58b93639367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } } }
I20260809 19:01:36.293284 17741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:36.294064 17740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8dac30f54afd4e9f8322e58b93639367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dac30f54afd4e9f8322e58b93639367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } } }
I20260809 19:01:36.294402 17740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:36.294842 17748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:36.299459 17748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:36.308004 17748 catalog_manager.cc:1347] Generated new cluster ID: 5750e853c6ef484391ac9ad1db5363a9
I20260809 19:01:36.308120 17748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:36.322062 17748 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:36.323894 17748 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:36.335827 17748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8dac30f54afd4e9f8322e58b93639367: Generated new TSK 0
I20260809 19:01:36.336887 17748 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:36.349969 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17625
W20260809 19:01:36.350977 17716 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54253
W20260809 19:01:36.351604 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17625: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:36.351766 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17625
2026-08-09T19:01:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2015 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:36 dist-test-slave-266d krb5kdc[17780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:36 dist-test-slave-266d krb5kdc[17780](info): set up 2 sockets
Aug 09 19:01:36 dist-test-slave-266d krb5kdc[17780](info): commencing operation
krb5kdc: starting...
W20260809 19:01:37.567517 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:37 dist-test-slave-266d krb5kdc[17780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:37.858011 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40285
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:38.191460 17797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:38.191819 17797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:38.191941 17797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:38.199591 17797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:38.199738 17797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:38.199800 17797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:38.199870 17797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:38.199922 17797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:38.210191 17797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:38.211503 17797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:38.212894 17797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:38.225172 17804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:38.225286 17802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:38.225371 17807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:38.225591 17797 server_base.cc:1034] running on GCE node
I20260809 19:01:38.226612 17797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:38.227980 17797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:38.229166 17797 hybrid_clock.cc:648] HybridClock initialized: now 1786302098229111 us; error 45 us; skew 500 ppm
I20260809 19:01:38.229494 17797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:38 dist-test-slave-266d krb5kdc[17780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302098, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:38.232666 17797 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:38.234158 17797 webserver.cc:460] Webserver started at http://127.0.0.1:41139/ using document root <none> and password file <none>
I20260809 19:01:38.234833 17797 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:38.234951 17797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:38.235298 17797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:38.238395 17797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "9e4eaac41a2145048680827446d0bce6"
format_stamp: "Formatted at 2026-08-09 19:01:38 on dist-test-slave-266d"
server_key: "3a68eca393e39e38dba2014b81a2019c"
server_key_iv: "adf8e78bcbfdec2cede01a974f1e7818"
server_key_version: "encryptionkey@0"
I20260809 19:01:38.239192 17797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "9e4eaac41a2145048680827446d0bce6"
format_stamp: "Formatted at 2026-08-09 19:01:38 on dist-test-slave-266d"
server_key: "3a68eca393e39e38dba2014b81a2019c"
server_key_iv: "adf8e78bcbfdec2cede01a974f1e7818"
server_key_version: "encryptionkey@0"
I20260809 19:01:38.244493 17797 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 19:01:38.248313 17817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:38.249768 17797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:38.249959 17797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "9e4eaac41a2145048680827446d0bce6"
format_stamp: "Formatted at 2026-08-09 19:01:38 on dist-test-slave-266d"
server_key: "3a68eca393e39e38dba2014b81a2019c"
server_key_iv: "adf8e78bcbfdec2cede01a974f1e7818"
server_key_version: "encryptionkey@0"
I20260809 19:01:38.250165 17797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:38.256843 17797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:38.261132 17797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:38.261462 17797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:38.279886 17797 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40285
I20260809 19:01:38.279925 17904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40285 every 8 connection(s)
I20260809 19:01:38.281463 17797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:38.285548 17907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:38.286420 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17797
I20260809 19:01:38.286595 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:38.287056 17139 external_mini_cluster.cc:1428] Setting key 1042c689b9c9b412f1882b61ab882bb6
I20260809 19:01:38.296697 17910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:38.289121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58579 (local address 127.0.0.1:40285)
0809 19:01:38.290023 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:38.290041 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:38.290097 (+ 56us) server_negotiation.cc:407] Connection header received
0809 19:01:38.292478 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:38.292515 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:38.293045 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:38.293586 (+ 541us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:38.294577 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:38.294586 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:38.294604 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:38.294621 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:38.294694 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:38.294725 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:38.294959 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:38.295087 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 19:01:38.295312 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":358,"threads_started":1}
I20260809 19:01:38.301352 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:38.301651 17907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6: Bootstrap starting.
I20260809 19:01:38.304986 17907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:38.306335 17907 log.cc:824] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:38.308527 17910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:38.305770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54053 (local address 127.0.0.1:40285)
0809 19:01:38.305983 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:38.305991 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:38.306500 (+ 509us) server_negotiation.cc:407] Connection header received
0809 19:01:38.306690 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:38.306694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:38.306750 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:38.306834 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:38.307812 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:38.307816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:38.307819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:38.307834 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:38.307875 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:38.307891 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:38.307980 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:38.308178 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 19:01:38.308235 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 19:01:38.309830 17907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6: No bootstrap required, opened a new log
I20260809 19:01:38.317734 17907 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4eaac41a2145048680827446d0bce6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40285 } }
I20260809 19:01:38.318178 17907 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:38.318279 17907 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e4eaac41a2145048680827446d0bce6, State: Initialized, Role: FOLLOWER
I20260809 19:01:38.318889 17907 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4eaac41a2145048680827446d0bce6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40285 } }
I20260809 19:01:38.319130 17907 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:38.319268 17907 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:38.319424 17907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:38.321985 17907 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4eaac41a2145048680827446d0bce6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40285 } }
I20260809 19:01:38.322468 17907 leader_election.cc:302] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e4eaac41a2145048680827446d0bce6; no voters:
I20260809 19:01:38.323082 17907 leader_election.cc:288] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:38.323216 17921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:38.323866 17921 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [term 1 LEADER]: Becoming Leader. State: Replica: 9e4eaac41a2145048680827446d0bce6, State: Running, Role: LEADER
I20260809 19:01:38.324411 17921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4eaac41a2145048680827446d0bce6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40285 } }
I20260809 19:01:38.325120 17907 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:38.327247 17924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e4eaac41a2145048680827446d0bce6. Latest consensus state: current_term: 1 leader_uuid: "9e4eaac41a2145048680827446d0bce6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4eaac41a2145048680827446d0bce6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40285 } } }
I20260809 19:01:38.327271 17922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e4eaac41a2145048680827446d0bce6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4eaac41a2145048680827446d0bce6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40285 } } }
I20260809 19:01:38.327956 17922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:38.327962 17924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:38.329622 17932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:38.334867 17932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:38.344079 17932 catalog_manager.cc:1347] Generated new cluster ID: ac09efecb4354132968e16199a8f1b2e
I20260809 19:01:38.344193 17932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:38.357414 17932 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:38.357924 17932 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:38.370294 17932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e4eaac41a2145048680827446d0bce6: Generated new TSK 0
I20260809 19:01:38.371345 17932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:38.381181 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17797
W20260809 19:01:38.382721 17899 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58579
W20260809 19:01:38.383463 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17797: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:38.383620 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17797
2026-08-09T19:01:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2030 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:38 dist-test-slave-266d krb5kdc[17962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:38 dist-test-slave-266d krb5kdc[17962](info): set up 2 sockets
Aug 09 19:01:38 dist-test-slave-266d krb5kdc[17962](info): commencing operation
krb5kdc: starting...
W20260809 19:01:39.635494 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.002s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:39 dist-test-slave-266d krb5kdc[17962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:39.922479 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38859
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:40.246917 17985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:40.247196 17985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:40.247337 17985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:40.254305 17985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:40.254400 17985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:40.254475 17985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:40.254565 17985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:40.254621 17985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:40.264022 17985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:40.265184 17985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:40.266391 17985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:40.277117 17990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:40.277205 17991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:40.277351 17994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:40.278087 17985 server_base.cc:1034] running on GCE node
I20260809 19:01:40.278781 17985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:40.280032 17985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:40.281219 17985 hybrid_clock.cc:648] HybridClock initialized: now 1786302100281175 us; error 39 us; skew 500 ppm
I20260809 19:01:40.281541 17985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:40 dist-test-slave-266d krb5kdc[17962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302100, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:40.284391 17985 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:40.285774 17985 webserver.cc:460] Webserver started at http://127.0.0.1:45967/ using document root <none> and password file <none>
I20260809 19:01:40.286383 17985 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:40.286506 17985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:40.286783 17985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:40.289595 17985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "db1dd32f115841a5a03543f43e06a0d9"
format_stamp: "Formatted at 2026-08-09 19:01:40 on dist-test-slave-266d"
server_key: "8014392898cba6a2bfd17473c21a2a3e"
server_key_iv: "133b2bfb77465ce32b66be6b144460ae"
server_key_version: "encryptionkey@0"
I20260809 19:01:40.290333 17985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "db1dd32f115841a5a03543f43e06a0d9"
format_stamp: "Formatted at 2026-08-09 19:01:40 on dist-test-slave-266d"
server_key: "8014392898cba6a2bfd17473c21a2a3e"
server_key_iv: "133b2bfb77465ce32b66be6b144460ae"
server_key_version: "encryptionkey@0"
I20260809 19:01:40.295061 17985 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:01:40.298210 18002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:40.299346 17985 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 19:01:40.299506 17985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "db1dd32f115841a5a03543f43e06a0d9"
format_stamp: "Formatted at 2026-08-09 19:01:40 on dist-test-slave-266d"
server_key: "8014392898cba6a2bfd17473c21a2a3e"
server_key_iv: "133b2bfb77465ce32b66be6b144460ae"
server_key_version: "encryptionkey@0"
I20260809 19:01:40.299671 17985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:40.333870 17985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:40.337684 17985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:40.337951 17985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:40.368848 17985 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38859
I20260809 19:01:40.368938 18079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38859 every 8 connection(s)
I20260809 19:01:40.372640 17985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:40.377647 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 17985
I20260809 19:01:40.378142 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:40.379881 17139 external_mini_cluster.cc:1428] Setting key aa3e1302b2e18c8895fb5e59e8300014
I20260809 19:01:40.387691 18081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 19:01:40 dist-test-slave-266d krb5kdc[17962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:01:40.453630 18081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9: Bootstrap starting.
I20260809 19:01:40.466449 18081 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:40.469272 18081 log.cc:824] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:40.474373 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:40.388315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:42283 (local address 127.0.0.1:38859)
0809 19:01:40.389993 (+ 1678us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:40.390019 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:40.390097 (+ 78us) server_negotiation.cc:407] Connection header received
0809 19:01:40.397063 (+ 6966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:40.397269 (+ 206us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:40.398894 (+ 1625us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:40.400078 (+ 1184us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:40.404832 (+ 4754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:40.414941 (+ 10109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:40.418771 (+ 3830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:40.423410 (+ 4639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:40.423914 (+ 504us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:40.449338 (+ 25424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:40.449382 (+ 44us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:40.449437 (+ 55us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:40.449630 (+ 193us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:40.458219 (+ 8589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:40.461594 (+ 3375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:40.461622 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:40.461676 (+ 54us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:40.462296 (+ 620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:40.464685 (+ 2389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:40.464691 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:40.464694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:40.466298 (+ 1604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:40.466867 (+ 569us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:40.467956 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0809 19:01:40.468589 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1089,"thread_start_us":587,"threads_started":1}
I20260809 19:01:40.486538 18081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9: No bootstrap required, opened a new log
I20260809 19:01:40.492115 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:40.539577 18081 raft_consensus.cc:348] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1dd32f115841a5a03543f43e06a0d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38859 } }
I20260809 19:01:40.541052 18081 raft_consensus.cc:374] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:40.541379 18081 raft_consensus.cc:729] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db1dd32f115841a5a03543f43e06a0d9, State: Initialized, Role: FOLLOWER
I20260809 19:01:40.543212 18081 consensus_queue.cc:260] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1dd32f115841a5a03543f43e06a0d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38859 } }
I20260809 19:01:40.544649 18081 raft_consensus.cc:388] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:40.545288 18081 raft_consensus.cc:482] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:40.546000 18081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:40.556368 18081 raft_consensus.cc:504] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1dd32f115841a5a03543f43e06a0d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38859 } }
I20260809 19:01:40.558048 18081 leader_election.cc:302] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db1dd32f115841a5a03543f43e06a0d9; no voters:
I20260809 19:01:40.560954 18081 leader_election.cc:288] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:40.561183 18100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:40.567939 18100 raft_consensus.cc:686] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [term 1 LEADER]: Becoming Leader. State: Replica: db1dd32f115841a5a03543f43e06a0d9, State: Running, Role: LEADER
I20260809 19:01:40.571240 18100 consensus_queue.cc:237] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1dd32f115841a5a03543f43e06a0d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38859 } }
I20260809 19:01:40.574188 18081 sys_catalog.cc:564] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:40.576918 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:40.507205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:45335 (local address 127.0.0.1:38859)
0809 19:01:40.507682 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:40.507700 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:40.508750 (+ 1050us) server_negotiation.cc:407] Connection header received
0809 19:01:40.509378 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:40.509406 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:40.509636 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:40.509870 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:40.520955 (+ 11085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:40.523916 (+ 2961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:40.536192 (+ 12276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:40.537547 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:40.538062 (+ 515us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:40.549203 (+ 11141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:40.549223 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:40.549226 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:40.549320 (+ 94us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:40.557161 (+ 7841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:40.561271 (+ 4110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:40.561335 (+ 64us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:40.561389 (+ 54us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:40.562305 (+ 916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:40.566560 (+ 4255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:40.566582 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:40.566586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:40.569467 (+ 2881us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:40.571557 (+ 2090us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:40.573389 (+ 1832us) server_negotiation.cc:299] Negotiation successful
0809 19:01:40.574909 (+ 1520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 19:01:40.584803 18101 sys_catalog.cc:455] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db1dd32f115841a5a03543f43e06a0d9. Latest consensus state: current_term: 1 leader_uuid: "db1dd32f115841a5a03543f43e06a0d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1dd32f115841a5a03543f43e06a0d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38859 } } }
I20260809 19:01:40.586270 18101 sys_catalog.cc:458] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:40.585704 18102 sys_catalog.cc:455] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db1dd32f115841a5a03543f43e06a0d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db1dd32f115841a5a03543f43e06a0d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38859 } } }
I20260809 19:01:40.586845 18102 sys_catalog.cc:458] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9 [sys.catalog]: This master's current role is: LEADER
W20260809 19:01:40.590240 18010 tablet.cc:2369] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:01:40.594017 18111 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:40.609771 18111 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:40.628859 18111 catalog_manager.cc:1347] Generated new cluster ID: 148e9a80cef64e87906441501cc14757
I20260809 19:01:40.629113 18111 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:40.665583 18111 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:40.667907 18111 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:40.691213 18111 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db1dd32f115841a5a03543f43e06a0d9: Generated new TSK 0
I20260809 19:01:40.697300 18111 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:40.716142 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 17985
I20260809 19:01:40.720932 18074 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:40.903466 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 17985
W20260809 19:01:40.946229 17959 connection.cc:535] client connection to 127.0.0.1:38859 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38859): Connection reset by peer (error 104)
2026-08-09T19:01:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:41 dist-test-slave-266d krb5kdc[18131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:41 dist-test-slave-266d krb5kdc[18131](info): set up 2 sockets
Aug 09 19:01:41 dist-test-slave-266d krb5kdc[18131](info): commencing operation
krb5kdc: starting...
W20260809 19:01:42.195346 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:42 dist-test-slave-266d krb5kdc[18131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:42.478150 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42923
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:42.828975 18154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:42.829272 18154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:42.829411 18154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:42.836457 18154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:42.836562 18154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:42.836647 18154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:42.836730 18154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:42.836789 18154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:42.846396 18154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:42.847683 18154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:42.848929 18154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:42.860306 18165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:42.860342 18169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:42.860387 18167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:42.861228 18154 server_base.cc:1034] running on GCE node
I20260809 19:01:42.861972 18154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:42.863353 18154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:42.864558 18154 hybrid_clock.cc:648] HybridClock initialized: now 1786302102864501 us; error 47 us; skew 500 ppm
I20260809 19:01:42.864886 18154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:42 dist-test-slave-266d krb5kdc[18131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302102, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:42.867954 18154 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:42.869459 18154 webserver.cc:460] Webserver started at http://127.0.0.1:36453/ using document root <none> and password file <none>
I20260809 19:01:42.870100 18154 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:42.870223 18154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:42.870486 18154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:42.873406 18154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "e96f4f28b74949c383ddba59208daca1"
format_stamp: "Formatted at 2026-08-09 19:01:42 on dist-test-slave-266d"
server_key: "752a2d611bd4506d67d35f86c98f4de2"
server_key_iv: "bf7c185b6be5f88de6323dba89c6498b"
server_key_version: "encryptionkey@0"
I20260809 19:01:42.874130 18154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "e96f4f28b74949c383ddba59208daca1"
format_stamp: "Formatted at 2026-08-09 19:01:42 on dist-test-slave-266d"
server_key: "752a2d611bd4506d67d35f86c98f4de2"
server_key_iv: "bf7c185b6be5f88de6323dba89c6498b"
server_key_version: "encryptionkey@0"
I20260809 19:01:42.879145 18154 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 19:01:42.882472 18178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:42.883677 18154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:01:42.883852 18154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "e96f4f28b74949c383ddba59208daca1"
format_stamp: "Formatted at 2026-08-09 19:01:42 on dist-test-slave-266d"
server_key: "752a2d611bd4506d67d35f86c98f4de2"
server_key_iv: "bf7c185b6be5f88de6323dba89c6498b"
server_key_version: "encryptionkey@0"
I20260809 19:01:42.884030 18154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:42.925395 18154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:42.929543 18154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:42.929816 18154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:42.947569 18154 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42923
I20260809 19:01:42.947595 18255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42923 every 8 connection(s)
I20260809 19:01:42.948946 18154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:42.950135 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18154
I20260809 19:01:42.950335 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:42.950874 17139 external_mini_cluster.cc:1428] Setting key 5f00074b31fe7a474df975ace3a567c8
I20260809 19:01:42.953455 18256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:42.963798 18260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:42.952658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:37583 (local address 127.0.0.1:42923)
0809 19:01:42.953415 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:42.953425 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:42.953469 (+ 44us) server_negotiation.cc:407] Connection header received
0809 19:01:42.955111 (+ 1642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:42.955131 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:42.955498 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:42.955823 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:42.956398 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:42.957744 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:42.959521 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:42.960178 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:42.960300 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:42.961532 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:42.961540 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:42.961552 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:42.962087 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:42.962165 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:42.962192 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:42.962346 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:42.962677 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 19:01:42.962852 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":310,"threads_started":1}
I20260809 19:01:42.965052 18256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1: Bootstrap starting.
I20260809 19:01:42.967303 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:42.968158 18256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:42.969341 18256 log.cc:824] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:42.972422 18256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1: No bootstrap required, opened a new log
I20260809 19:01:42.978562 18260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:42.972204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:45729 (local address 127.0.0.1:42923)
0809 19:01:42.972386 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:42.972391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:42.972808 (+ 417us) server_negotiation.cc:407] Connection header received
0809 19:01:42.972934 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:42.972939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:42.973014 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:42.973142 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:42.973590 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:42.974731 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:42.976014 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:42.976670 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:42.976800 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:42.977839 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:42.977844 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:42.977847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:42.977863 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:42.977898 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:42.977916 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:42.978002 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:42.978196 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 19:01:42.978237 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:01:42.981235 18256 raft_consensus.cc:348] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96f4f28b74949c383ddba59208daca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } }
I20260809 19:01:42.981624 18256 raft_consensus.cc:374] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:42.981724 18256 raft_consensus.cc:729] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e96f4f28b74949c383ddba59208daca1, State: Initialized, Role: FOLLOWER
I20260809 19:01:42.982237 18256 consensus_queue.cc:260] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96f4f28b74949c383ddba59208daca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } }
I20260809 19:01:42.982451 18256 raft_consensus.cc:388] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:42.982573 18256 raft_consensus.cc:482] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:42.982730 18256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:42.984721 18256 raft_consensus.cc:504] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96f4f28b74949c383ddba59208daca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } }
I20260809 19:01:42.985231 18256 leader_election.cc:302] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e96f4f28b74949c383ddba59208daca1; no voters:
I20260809 19:01:42.985754 18256 leader_election.cc:288] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:42.985873 18270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:42.986450 18270 raft_consensus.cc:686] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [term 1 LEADER]: Becoming Leader. State: Replica: e96f4f28b74949c383ddba59208daca1, State: Running, Role: LEADER
I20260809 19:01:42.986997 18270 consensus_queue.cc:237] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96f4f28b74949c383ddba59208daca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } }
I20260809 19:01:42.987694 18256 sys_catalog.cc:564] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:42.989802 18272 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e96f4f28b74949c383ddba59208daca1. Latest consensus state: current_term: 1 leader_uuid: "e96f4f28b74949c383ddba59208daca1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96f4f28b74949c383ddba59208daca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } } }
I20260809 19:01:42.989898 18271 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e96f4f28b74949c383ddba59208daca1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96f4f28b74949c383ddba59208daca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } } }
I20260809 19:01:42.990139 18272 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:42.990213 18271 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:42.990967 18276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:42.997231 18276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:43.008533 18276 catalog_manager.cc:1347] Generated new cluster ID: 73a1a14bdb6f4e1380bec8f3f0dcb8f2
I20260809 19:01:43.008682 18276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:43.034813 18276 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:43.036094 18276 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:43.042153 18276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e96f4f28b74949c383ddba59208daca1: Generated new TSK 0
I20260809 19:01:43.042917 18276 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:43.057228 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18154
W20260809 19:01:43.058449 18248 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.165:37583
W20260809 19:01:43.059103 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18154: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:43.059252 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18154
W20260809 19:01:43.083833 18129 connection.cc:535] client connection to 127.0.0.1:42923 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42923): Connection reset by peer (error 104)
2026-08-09T19:01:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2127 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:43 dist-test-slave-266d krb5kdc[18297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:43 dist-test-slave-266d krb5kdc[18297](info): set up 2 sockets
Aug 09 19:01:43 dist-test-slave-266d krb5kdc[18297](info): commencing operation
krb5kdc: starting...
W20260809 19:01:44.287772 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:44 dist-test-slave-266d krb5kdc[18297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:44.581157 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43377
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:44.910874 18315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:44.911155 18315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:44.911302 18315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:44.918316 18315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:44.918427 18315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:44.918505 18315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:44.918587 18315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:44.918645 18315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:44.928153 18315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:44.929404 18315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:44.930687 18315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:44.941990 18324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:44.942042 18326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:44.942076 18321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:44.942835 18315 server_base.cc:1034] running on GCE node
I20260809 19:01:44.943557 18315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:44.944901 18315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:44.946101 18315 hybrid_clock.cc:648] HybridClock initialized: now 1786302104946048 us; error 43 us; skew 500 ppm
I20260809 19:01:44.946431 18315 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:44 dist-test-slave-266d krb5kdc[18297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302104, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:44.949429 18315 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:44.950917 18315 webserver.cc:460] Webserver started at http://127.0.0.1:36037/ using document root <none> and password file <none>
I20260809 19:01:44.951571 18315 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:44.951687 18315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:44.951973 18315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:44.954907 18315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "52176f52749040a68b7b9412780771ce"
format_stamp: "Formatted at 2026-08-09 19:01:44 on dist-test-slave-266d"
server_key: "3dcc6c6407bb5624b9376d7141eb0ecf"
server_key_iv: "3beb9d03038a95e33295d93a6c1e1216"
server_key_version: "encryptionkey@0"
I20260809 19:01:44.955642 18315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "52176f52749040a68b7b9412780771ce"
format_stamp: "Formatted at 2026-08-09 19:01:44 on dist-test-slave-266d"
server_key: "3dcc6c6407bb5624b9376d7141eb0ecf"
server_key_iv: "3beb9d03038a95e33295d93a6c1e1216"
server_key_version: "encryptionkey@0"
I20260809 19:01:44.960649 18315 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 19:01:44.964021 18338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:44.965238 18315 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:44.965394 18315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "52176f52749040a68b7b9412780771ce"
format_stamp: "Formatted at 2026-08-09 19:01:44 on dist-test-slave-266d"
server_key: "3dcc6c6407bb5624b9376d7141eb0ecf"
server_key_iv: "3beb9d03038a95e33295d93a6c1e1216"
server_key_version: "encryptionkey@0"
I20260809 19:01:44.965564 18315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:44.971200 18315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:44.974844 18315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:44.975103 18315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:44.991997 18315 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43377
I20260809 19:01:44.992041 18413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43377 every 8 connection(s)
I20260809 19:01:44.993322 18315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:44.996857 18415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:44.998318 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18315
I20260809 19:01:44.998472 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:44.998908 17139 external_mini_cluster.cc:1428] Setting key 17e6464e2d917c0e931d475b6bc124e5
I20260809 19:01:45.006377 18418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:45.000680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:48549 (local address 127.0.0.1:43377)
0809 19:01:45.001493 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:45.001505 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:45.001552 (+ 47us) server_negotiation.cc:407] Connection header received
0809 19:01:45.003148 (+ 1596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:45.003171 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:45.003501 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:45.003851 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:45.004857 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:45.004864 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:45.004876 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:45.004891 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:45.004949 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:45.004972 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:45.005207 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:45.005351 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 19:01:45.005513 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":355,"threads_started":1}
I20260809 19:01:45.009820 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:45.010329 18415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce: Bootstrap starting.
I20260809 19:01:45.013474 18415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:45.014695 18415 log.cc:824] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:45.016433 18418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:45.014065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:38749 (local address 127.0.0.1:43377)
0809 19:01:45.014231 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:45.014236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:45.014497 (+ 261us) server_negotiation.cc:407] Connection header received
0809 19:01:45.014645 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:45.014650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:45.014699 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:45.014772 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:45.015715 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:45.015719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:45.015723 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:45.015740 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:45.015779 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:45.015795 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:45.015911 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:45.016035 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 19:01:45.016112 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 19:01:45.017855 18415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce: No bootstrap required, opened a new log
I20260809 19:01:45.025453 18415 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52176f52749040a68b7b9412780771ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43377 } }
I20260809 19:01:45.025930 18415 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:45.026036 18415 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52176f52749040a68b7b9412780771ce, State: Initialized, Role: FOLLOWER
I20260809 19:01:45.026621 18415 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52176f52749040a68b7b9412780771ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43377 } }
I20260809 19:01:45.026855 18415 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:45.027014 18415 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:45.027189 18415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:45.029462 18415 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52176f52749040a68b7b9412780771ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43377 } }
I20260809 19:01:45.029971 18415 leader_election.cc:302] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52176f52749040a68b7b9412780771ce; no voters:
I20260809 19:01:45.030529 18415 leader_election.cc:288] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:45.030624 18427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:45.031213 18427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [term 1 LEADER]: Becoming Leader. State: Replica: 52176f52749040a68b7b9412780771ce, State: Running, Role: LEADER
I20260809 19:01:45.031776 18427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52176f52749040a68b7b9412780771ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43377 } }
I20260809 19:01:45.032683 18415 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:45.034178 18429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52176f52749040a68b7b9412780771ce. Latest consensus state: current_term: 1 leader_uuid: "52176f52749040a68b7b9412780771ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52176f52749040a68b7b9412780771ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43377 } } }
I20260809 19:01:45.034579 18429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:45.035581 18433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:45.035337 18428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52176f52749040a68b7b9412780771ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52176f52749040a68b7b9412780771ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43377 } } }
I20260809 19:01:45.036515 18428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:45.041706 18433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:45.050134 18433 catalog_manager.cc:1347] Generated new cluster ID: 6026bfc5adce4859868d25256560f2f1
I20260809 19:01:45.050236 18433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:45.065167 18433 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:45.065606 18433 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:45.072423 18433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52176f52749040a68b7b9412780771ce: Generated new TSK 0
I20260809 19:01:45.073132 18433 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:45.087929 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18315
W20260809 19:01:45.089041 18408 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.165:48549
W20260809 19:01:45.089723 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18315: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:45.089880 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18315
2026-08-09T19:01:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2031 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:45 dist-test-slave-266d krb5kdc[18455](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:45 dist-test-slave-266d krb5kdc[18455](info): set up 2 sockets
Aug 09 19:01:45 dist-test-slave-266d krb5kdc[18455](info): commencing operation
krb5kdc: starting...
W20260809 19:01:46.317822 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.002s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:46 dist-test-slave-266d krb5kdc[18455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:46.610284 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44303
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:46.948596 18476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:46.948877 18476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:46.948977 18476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:46.956028 18476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:46.956127 18476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:46.956180 18476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:46.956238 18476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:46.956281 18476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:46.965871 18476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44303
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:46.967039 18476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:46.968266 18476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:46.979640 18485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:46.979678 18490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:46.979729 18488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:46.980636 18476 server_base.cc:1034] running on GCE node
I20260809 19:01:46.981423 18476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:46.982668 18476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:46.983863 18476 hybrid_clock.cc:648] HybridClock initialized: now 1786302106983821 us; error 44 us; skew 500 ppm
I20260809 19:01:46.984190 18476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:46 dist-test-slave-266d krb5kdc[18455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302106, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:46.992682 18476 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:46.994261 18476 webserver.cc:460] Webserver started at http://127.0.0.1:44985/ using document root <none> and password file <none>
I20260809 19:01:46.994932 18476 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:46.995054 18476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:46.995352 18476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:46.998322 18476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "ecf88aa40f5e48c1a301a33e585a6556"
format_stamp: "Formatted at 2026-08-09 19:01:46 on dist-test-slave-266d"
server_key: "91298f58bdfd569823235a4c18dc96ff"
server_key_iv: "73ae64bd949914ae6e083946e98dc0bc"
server_key_version: "encryptionkey@0"
I20260809 19:01:46.999073 18476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "ecf88aa40f5e48c1a301a33e585a6556"
format_stamp: "Formatted at 2026-08-09 19:01:46 on dist-test-slave-266d"
server_key: "91298f58bdfd569823235a4c18dc96ff"
server_key_iv: "73ae64bd949914ae6e083946e98dc0bc"
server_key_version: "encryptionkey@0"
I20260809 19:01:47.004272 18476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260809 19:01:47.007553 18503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:47.008806 18476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:01:47.008971 18476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "ecf88aa40f5e48c1a301a33e585a6556"
format_stamp: "Formatted at 2026-08-09 19:01:46 on dist-test-slave-266d"
server_key: "91298f58bdfd569823235a4c18dc96ff"
server_key_iv: "73ae64bd949914ae6e083946e98dc0bc"
server_key_version: "encryptionkey@0"
I20260809 19:01:47.009181 18476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:47.037887 18476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:47.041595 18476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:47.041853 18476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:47.058710 18476 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44303
I20260809 19:01:47.058704 18581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44303 every 8 connection(s)
I20260809 19:01:47.060009 18476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:47.063537 18582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:47.069154 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18476
I20260809 19:01:47.069355 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:47.069918 17139 external_mini_cluster.cc:1428] Setting key bb03a57297d77cb20909706632f6bcd5
I20260809 19:01:47.074016 18582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556: Bootstrap starting.
I20260809 19:01:47.077451 18582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:47.078528 18582 log.cc:824] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:47.081171 18582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556: No bootstrap required, opened a new log
Aug 09 19:01:47 dist-test-slave-266d krb5kdc[18455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 19:01:47.088492 18582 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecf88aa40f5e48c1a301a33e585a6556" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44303 } }
I20260809 19:01:47.088825 18582 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:47.088929 18582 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf88aa40f5e48c1a301a33e585a6556, State: Initialized, Role: FOLLOWER
I20260809 19:01:47.089532 18582 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecf88aa40f5e48c1a301a33e585a6556" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44303 } }
I20260809 19:01:47.089767 18582 raft_consensus.cc:388] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:47.089900 18582 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:47.090093 18582 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:47.091845 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:47.071791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:36363 (local address 127.0.0.1:44303)
0809 19:01:47.072554 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:47.072565 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:47.072607 (+ 42us) server_negotiation.cc:407] Connection header received
0809 19:01:47.074251 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:47.074273 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:47.074624 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:47.074910 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:47.076656 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:47.077995 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:47.079615 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:47.080248 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:47.080412 (+ 164us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:47.084330 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:47.084337 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:47.084351 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:47.084394 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:47.087429 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:47.088151 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:47.088157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:47.088162 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:47.088321 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:47.088758 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:47.088769 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:47.088771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:47.089376 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:47.089669 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:47.090209 (+ 540us) server_negotiation.cc:299] Negotiation successful
0809 19:01:47.090544 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":368,"threads_started":1}
I20260809 19:01:47.093341 18582 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecf88aa40f5e48c1a301a33e585a6556" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44303 } }
I20260809 19:01:47.093815 18582 leader_election.cc:302] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecf88aa40f5e48c1a301a33e585a6556; no voters:
I20260809 19:01:47.094412 18582 leader_election.cc:288] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:47.094496 18588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:47.095779 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:47.095847 18588 raft_consensus.cc:686] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [term 1 LEADER]: Becoming Leader. State: Replica: ecf88aa40f5e48c1a301a33e585a6556, State: Running, Role: LEADER
I20260809 19:01:47.096300 18588 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecf88aa40f5e48c1a301a33e585a6556" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44303 } }
I20260809 19:01:47.096498 18582 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:47.098686 18589 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ecf88aa40f5e48c1a301a33e585a6556" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecf88aa40f5e48c1a301a33e585a6556" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44303 } } }
I20260809 19:01:47.099056 18589 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:47.101349 18590 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecf88aa40f5e48c1a301a33e585a6556. Latest consensus state: current_term: 1 leader_uuid: "ecf88aa40f5e48c1a301a33e585a6556" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecf88aa40f5e48c1a301a33e585a6556" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44303 } } }
I20260809 19:01:47.101649 18590 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:47.103595 18597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:47.109477 18597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:47.123654 18597 catalog_manager.cc:1347] Generated new cluster ID: 7339e804c9cc4516b4469eedfd701f7e
I20260809 19:01:47.123801 18597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:47.134526 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:47.107317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:60671 (local address 127.0.0.1:44303)
0809 19:01:47.107528 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:47.107546 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:47.117171 (+ 9625us) server_negotiation.cc:407] Connection header received
0809 19:01:47.117265 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:47.117271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:47.117373 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:47.117521 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:47.119487 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:47.120845 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:47.122731 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:47.123436 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:47.123568 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:47.127023 (+ 3455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:47.127031 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:47.127036 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:47.127078 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:47.130839 (+ 3761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:47.131801 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:47.131807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:47.131811 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:47.131968 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:47.132576 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:47.132582 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:47.132585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:47.132981 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:47.133246 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:47.133940 (+ 694us) server_negotiation.cc:299] Negotiation successful
0809 19:01:47.134125 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 19:01:47.151319 18597 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:47.152650 18597 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:47.161933 18597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ecf88aa40f5e48c1a301a33e585a6556: Generated new TSK 0
I20260809 19:01:47.162906 18597 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:47.172966 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18476
I20260809 19:01:47.175159 18575 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:47.265225 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18476
W20260809 19:01:47.290583 18450 connection.cc:535] client connection to 127.0.0.1:44303 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44303): Connection reset by peer (error 104)
2026-08-09T19:01:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2175 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:47 dist-test-slave-266d krb5kdc[18627](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:47 dist-test-slave-266d krb5kdc[18627](info): set up 2 sockets
Aug 09 19:01:47 dist-test-slave-266d krb5kdc[18627](info): commencing operation
krb5kdc: starting...
W20260809 19:01:48.490398 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:48 dist-test-slave-266d krb5kdc[18627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:48.767956 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44307
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:49.095790 18645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:49.096066 18645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:49.096184 18645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:49.103217 18645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:49.103319 18645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:49.103394 18645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:49.103471 18645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:49.103526 18645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:49.113130 18645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44307
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:49.114395 18645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:49.115658 18645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:49.126852 18654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:49.126883 18657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:49.126917 18651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:49.127768 18645 server_base.cc:1034] running on GCE node
I20260809 19:01:49.128464 18645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:49.129815 18645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:49.131006 18645 hybrid_clock.cc:648] HybridClock initialized: now 1786302109130965 us; error 29 us; skew 500 ppm
I20260809 19:01:49.131320 18645 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:49 dist-test-slave-266d krb5kdc[18627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302109, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:49.134301 18645 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:49.135651 18645 webserver.cc:460] Webserver started at http://127.0.0.1:37179/ using document root <none> and password file <none>
I20260809 19:01:49.136281 18645 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:49.136406 18645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:49.136689 18645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:49.139583 18645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "fe708465bce14858ac296bcac529cd78"
format_stamp: "Formatted at 2026-08-09 19:01:49 on dist-test-slave-266d"
server_key: "e1d6f09e12930e2dd66478eeef84048c"
server_key_iv: "a88e2e8deea0ccbdd944c5db6b66fdbc"
server_key_version: "encryptionkey@0"
I20260809 19:01:49.140291 18645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "fe708465bce14858ac296bcac529cd78"
format_stamp: "Formatted at 2026-08-09 19:01:49 on dist-test-slave-266d"
server_key: "e1d6f09e12930e2dd66478eeef84048c"
server_key_iv: "a88e2e8deea0ccbdd944c5db6b66fdbc"
server_key_version: "encryptionkey@0"
I20260809 19:01:49.145025 18645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 19:01:49.148173 18669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:49.149394 18645 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.003s
I20260809 19:01:49.149550 18645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "fe708465bce14858ac296bcac529cd78"
format_stamp: "Formatted at 2026-08-09 19:01:49 on dist-test-slave-266d"
server_key: "e1d6f09e12930e2dd66478eeef84048c"
server_key_iv: "a88e2e8deea0ccbdd944c5db6b66fdbc"
server_key_version: "encryptionkey@0"
I20260809 19:01:49.149724 18645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:49.170553 18645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:49.174397 18645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:49.174649 18645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:49.191820 18645 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44307
I20260809 19:01:49.191865 18737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44307 every 8 connection(s)
I20260809 19:01:49.193116 18645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:49.196714 18739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:49.202098 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18645
I20260809 19:01:49.202294 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:49.202840 17139 external_mini_cluster.cc:1428] Setting key cbfcdab438b92407fc4e52c4c5ae2ea6
I20260809 19:01:49.207693 18739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78: Bootstrap starting.
I20260809 19:01:49.211186 18739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:49.212308 18739 log.cc:824] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:49.215348 18739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78: No bootstrap required, opened a new log
I20260809 19:01:49.216563 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:49.204710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:34977 (local address 127.0.0.1:44307)
0809 19:01:49.205495 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:49.205505 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:49.205550 (+ 45us) server_negotiation.cc:407] Connection header received
0809 19:01:49.207162 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:49.207183 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:49.207547 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:49.207885 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:49.208488 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:49.209858 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:49.211671 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:49.212347 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:49.212512 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:49.213943 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:49.213953 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:49.213969 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:49.214621 (+ 652us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:49.214714 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:49.214745 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:49.214918 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:49.215183 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 19:01:49.215341 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":350,"threads_started":1}
I20260809 19:01:49.220445 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:49.223579 18739 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe708465bce14858ac296bcac529cd78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44307 } }
I20260809 19:01:49.223912 18739 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:49.224015 18739 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe708465bce14858ac296bcac529cd78, State: Initialized, Role: FOLLOWER
I20260809 19:01:49.224521 18739 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe708465bce14858ac296bcac529cd78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44307 } }
I20260809 19:01:49.224781 18739 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:49.224943 18739 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:49.225188 18739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:49.228194 18739 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe708465bce14858ac296bcac529cd78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44307 } }
I20260809 19:01:49.228643 18739 leader_election.cc:302] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe708465bce14858ac296bcac529cd78; no voters:
I20260809 19:01:49.229310 18739 leader_election.cc:288] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:49.229403 18758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:49.230536 18758 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [term 1 LEADER]: Becoming Leader. State: Replica: fe708465bce14858ac296bcac529cd78, State: Running, Role: LEADER
I20260809 19:01:49.231135 18758 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe708465bce14858ac296bcac529cd78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44307 } }
I20260809 19:01:49.231599 18739 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:49.232609 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:49.225249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:36955 (local address 127.0.0.1:44307)
0809 19:01:49.225407 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:49.225413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:49.225780 (+ 367us) server_negotiation.cc:407] Connection header received
0809 19:01:49.225941 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:49.225946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:49.226018 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:49.226120 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:49.226627 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:49.227708 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:49.229254 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:49.230040 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:49.230188 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:49.231680 (+ 1492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:49.231687 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:49.231692 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:49.231715 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:49.231794 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:49.231814 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:49.231923 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:49.232163 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 19:01:49.232219 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 19:01:49.234073 18759 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe708465bce14858ac296bcac529cd78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe708465bce14858ac296bcac529cd78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44307 } } }
I20260809 19:01:49.234539 18759 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:49.235342 18766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:49.235889 18761 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe708465bce14858ac296bcac529cd78. Latest consensus state: current_term: 1 leader_uuid: "fe708465bce14858ac296bcac529cd78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe708465bce14858ac296bcac529cd78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44307 } } }
I20260809 19:01:49.236289 18761 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:49.240625 18766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:49.250507 18766 catalog_manager.cc:1347] Generated new cluster ID: 4c179d6f0d314b4d92ec7952c4764c64
I20260809 19:01:49.250635 18766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:49.263993 18766 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:49.265697 18766 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:49.276006 18766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe708465bce14858ac296bcac529cd78: Generated new TSK 0
I20260809 19:01:49.276973 18766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:49.287856 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18645
W20260809 19:01:49.288858 18732 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.165:34977
W20260809 19:01:49.289552 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18645: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:49.289700 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18645
W20260809 19:01:49.316295 18623 connection.cc:535] client connection to 127.0.0.1:44307 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44307): Connection reset by peer (error 104)
2026-08-09T19:01:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2025 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:49 dist-test-slave-266d krb5kdc[18792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:49 dist-test-slave-266d krb5kdc[18792](info): set up 2 sockets
Aug 09 19:01:49 dist-test-slave-266d krb5kdc[18792](info): commencing operation
krb5kdc: starting...
W20260809 19:01:50.526129 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:50 dist-test-slave-266d krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302110, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 19:01:50.818256 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46485
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:51.143308 18814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:51.143566 18814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:51.143685 18814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:51.150589 18814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:51.150683 18814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:51.150753 18814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:51.150839 18814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:51.150897 18814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:51.160193 18814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46485
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:51.161358 18814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:51.162580 18814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:51.173581 18821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:51.173632 18826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:51.173656 18823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:51.174335 18814 server_base.cc:1034] running on GCE node
I20260809 19:01:51.175042 18814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:51.176301 18814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:51.177532 18814 hybrid_clock.cc:648] HybridClock initialized: now 1786302111177476 us; error 42 us; skew 500 ppm
I20260809 19:01:51.177902 18814 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:51 dist-test-slave-266d krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302111, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:51.180804 18814 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 19:01:51.182193 18814 webserver.cc:460] Webserver started at http://127.0.0.1:33931/ using document root <none> and password file <none>
I20260809 19:01:51.182807 18814 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:51.182907 18814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:51.183148 18814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:51.185971 18814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "05af7bf425f74769aa96f413268179d7"
format_stamp: "Formatted at 2026-08-09 19:01:51 on dist-test-slave-266d"
server_key: "c38747b8d1e82e4ea9e2794988762916"
server_key_iv: "4a7fcc9f5cb5c829782b5fc71da4c05e"
server_key_version: "encryptionkey@0"
I20260809 19:01:51.186666 18814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "05af7bf425f74769aa96f413268179d7"
format_stamp: "Formatted at 2026-08-09 19:01:51 on dist-test-slave-266d"
server_key: "c38747b8d1e82e4ea9e2794988762916"
server_key_iv: "4a7fcc9f5cb5c829782b5fc71da4c05e"
server_key_version: "encryptionkey@0"
I20260809 19:01:51.191536 18814 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:01:51.194794 18833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:51.196020 18814 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:01:51.196162 18814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "05af7bf425f74769aa96f413268179d7"
format_stamp: "Formatted at 2026-08-09 19:01:51 on dist-test-slave-266d"
server_key: "c38747b8d1e82e4ea9e2794988762916"
server_key_iv: "4a7fcc9f5cb5c829782b5fc71da4c05e"
server_key_version: "encryptionkey@0"
I20260809 19:01:51.196328 18814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:51.201982 18814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:51.205612 18814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:51.205862 18814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:51.222476 18814 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46485
I20260809 19:01:51.222534 18902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46485 every 8 connection(s)
I20260809 19:01:51.223770 18814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:51.227314 18903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:51.232396 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18814
I20260809 19:01:51.232559 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:51.233116 17139 external_mini_cluster.cc:1428] Setting key e9ad6d92fbc2046483c85363a25c033c
I20260809 19:01:51.238129 18903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7: Bootstrap starting.
I20260809 19:01:51.240577 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:51.234876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:46937 (local address 127.0.0.1:46485)
0809 19:01:51.235679 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:51.235694 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:51.235735 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:01:51.237437 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:51.237460 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:51.237776 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:51.238077 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:51.239127 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:51.239134 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:51.239148 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:51.239161 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:51.239219 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:51.239238 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:51.239397 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:51.239516 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 19:01:51.239684 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":355,"threads_started":1}
I20260809 19:01:51.241542 18903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:51.242826 18903 log.cc:824] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:51.244333 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:51.245932 18903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7: No bootstrap required, opened a new log
I20260809 19:01:51.251447 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:51.249120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.165:46635 (local address 127.0.0.1:46485)
0809 19:01:51.249278 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:51.249283 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:51.249737 (+ 454us) server_negotiation.cc:407] Connection header received
0809 19:01:51.249847 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:51.249851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:51.249910 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:51.250014 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:51.250864 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:51.250869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:51.250878 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:51.250896 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:51.250939 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:51.250962 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:51.251069 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:51.251114 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 19:01:51.251171 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 19:01:51.254441 18903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05af7bf425f74769aa96f413268179d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46485 } }
I20260809 19:01:51.254745 18903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:51.254818 18903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05af7bf425f74769aa96f413268179d7, State: Initialized, Role: FOLLOWER
I20260809 19:01:51.255331 18903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05af7bf425f74769aa96f413268179d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46485 } }
I20260809 19:01:51.255542 18903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:51.255637 18903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:51.255764 18903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:51.258132 18903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05af7bf425f74769aa96f413268179d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46485 } }
I20260809 19:01:51.258558 18903 leader_election.cc:302] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05af7bf425f74769aa96f413268179d7; no voters:
I20260809 19:01:51.259069 18903 leader_election.cc:288] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:51.259197 18919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:51.259853 18919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [term 1 LEADER]: Becoming Leader. State: Replica: 05af7bf425f74769aa96f413268179d7, State: Running, Role: LEADER
I20260809 19:01:51.260423 18919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05af7bf425f74769aa96f413268179d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46485 } }
I20260809 19:01:51.261327 18903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:51.262974 18921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05af7bf425f74769aa96f413268179d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05af7bf425f74769aa96f413268179d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46485 } } }
I20260809 19:01:51.263430 18921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:51.262940 18920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05af7bf425f74769aa96f413268179d7. Latest consensus state: current_term: 1 leader_uuid: "05af7bf425f74769aa96f413268179d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05af7bf425f74769aa96f413268179d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46485 } } }
I20260809 19:01:51.263823 18920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:51.264947 18925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:51.270215 18925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:51.278625 18925 catalog_manager.cc:1347] Generated new cluster ID: 9504560c6ae44a7390683487403acb93
I20260809 19:01:51.278736 18925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:51.297523 18925 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:51.297950 18925 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:51.304967 18925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05af7bf425f74769aa96f413268179d7: Generated new TSK 0
I20260809 19:01:51.305751 18925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:51.311704 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18814
W20260809 19:01:51.312722 18897 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.165:46937
W20260809 19:01:51.313342 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18814: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:51.313472 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18814
2026-08-09T19:01:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2021 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:51 dist-test-slave-266d krb5kdc[18950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:51 dist-test-slave-266d krb5kdc[18950](info): set up 2 sockets
Aug 09 19:01:51 dist-test-slave-266d krb5kdc[18950](info): commencing operation
krb5kdc: starting...
W20260809 19:01:52.534523 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:52 dist-test-slave-266d krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:01:52.816346 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:38219
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:36731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:38219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:53.142570 18966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:53.142859 18966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:53.143002 18966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:53.150004 18966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:53.150113 18966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:53.150188 18966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:53.150275 18966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:53.150333 18966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:53.159734 18966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:36731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:38219
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:38219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:53.160900 18966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:53.162173 18966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:53.173231 18972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:53.173264 18981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:53.173184 18975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:53.173908 18966 server_base.cc:1034] running on GCE node
I20260809 19:01:53.174623 18966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:53.175913 18966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:53.177146 18966 hybrid_clock.cc:648] HybridClock initialized: now 1786302113177084 us; error 41 us; skew 500 ppm
I20260809 19:01:53.177479 18966 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:53 dist-test-slave-266d krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302113, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:53.180447 18966 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:01:53.182051 18966 webserver.cc:460] Webserver started at http://127.16.188.254:35449/ using document root <none> and password file <none>
I20260809 19:01:53.182677 18966 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:53.182780 18966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:53.183040 18966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:53.185942 18966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "3b84e03102544ccf841a8c2890e86517"
format_stamp: "Formatted at 2026-08-09 19:01:53 on dist-test-slave-266d"
server_key: "a1b5806bcdd66e3abebe189c7f1d0b43"
server_key_iv: "f29831504c203f93cf55f9a7985a88de"
server_key_version: "encryptionkey@0"
I20260809 19:01:53.186640 18966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "3b84e03102544ccf841a8c2890e86517"
format_stamp: "Formatted at 2026-08-09 19:01:53 on dist-test-slave-266d"
server_key: "a1b5806bcdd66e3abebe189c7f1d0b43"
server_key_iv: "f29831504c203f93cf55f9a7985a88de"
server_key_version: "encryptionkey@0"
I20260809 19:01:53.191480 18966 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:01:53.194748 18991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:53.195962 18966 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 19:01:53.196102 18966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "3b84e03102544ccf841a8c2890e86517"
format_stamp: "Formatted at 2026-08-09 19:01:53 on dist-test-slave-266d"
server_key: "a1b5806bcdd66e3abebe189c7f1d0b43"
server_key_iv: "f29831504c203f93cf55f9a7985a88de"
server_key_version: "encryptionkey@0"
I20260809 19:01:53.196254 18966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:53.223980 18966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:53.228057 18966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:53.228289 18966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:53.244894 18966 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:38219
I20260809 19:01:53.244910 19064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:38219 every 8 connection(s)
I20260809 19:01:53.246233 18966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:53.249867 19065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:53.252381 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 18966
I20260809 19:01:53.252547 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:53.252965 17139 external_mini_cluster.cc:1428] Setting key 8b9faa41e7fc4410949432b655372169
I20260809 19:01:53.261018 19065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517: Bootstrap starting.
I20260809 19:01:53.264528 19065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:53.265790 19065 log.cc:824] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517: Log is configured to *not* fsync() on all Append() calls
Aug 09 19:01:53 dist-test-slave-266d krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:53.268718 19065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517: No bootstrap required, opened a new log
I20260809 19:01:53.275313 19069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:53.254693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37803 (local address 127.16.188.254:38219)
0809 19:01:53.255440 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:53.255452 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:53.255493 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:01:53.257130 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:53.257158 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:53.257529 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:53.257846 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:53.259533 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:53.260822 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:53.262632 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:53.263294 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:53.263428 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:53.268277 (+ 4849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:53.268284 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:53.268297 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:53.268331 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:53.271273 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:53.272141 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:53.272148 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:53.272154 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:53.272320 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:53.272804 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:53.272807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:53.272809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:53.273372 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:53.273621 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:53.274042 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 19:01:53.274307 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":325,"threads_started":1}
I20260809 19:01:53.277343 19065 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b84e03102544ccf841a8c2890e86517" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38219 } }
I20260809 19:01:53.277736 19065 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:53.277837 19065 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b84e03102544ccf841a8c2890e86517, State: Initialized, Role: FOLLOWER
I20260809 19:01:53.278434 19065 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b84e03102544ccf841a8c2890e86517" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38219 } }
I20260809 19:01:53.278685 19065 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:53.278844 19065 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:53.278967 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:53.279006 19065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:53.281078 19065 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b84e03102544ccf841a8c2890e86517" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38219 } }
I20260809 19:01:53.281713 19065 leader_election.cc:302] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b84e03102544ccf841a8c2890e86517; no voters:
I20260809 19:01:53.282333 19065 leader_election.cc:288] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:53.282445 19075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:53.283957 19075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [term 1 LEADER]: Becoming Leader. State: Replica: 3b84e03102544ccf841a8c2890e86517, State: Running, Role: LEADER
I20260809 19:01:53.284578 19065 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:53.284579 19075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b84e03102544ccf841a8c2890e86517" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38219 } }
I20260809 19:01:53.289170 19076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b84e03102544ccf841a8c2890e86517" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b84e03102544ccf841a8c2890e86517" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38219 } } }
I20260809 19:01:53.289523 19076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:53.300671 19093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:53.301160 19077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b84e03102544ccf841a8c2890e86517. Latest consensus state: current_term: 1 leader_uuid: "3b84e03102544ccf841a8c2890e86517" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b84e03102544ccf841a8c2890e86517" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 38219 } } }
I20260809 19:01:53.301540 19077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:53.302556 19069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:53.283498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59879 (local address 127.16.188.254:38219)
0809 19:01:53.283674 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:53.283680 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:53.285134 (+ 1454us) server_negotiation.cc:407] Connection header received
0809 19:01:53.285318 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:53.285323 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:53.285394 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:53.285502 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:53.287491 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:53.288696 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:53.290580 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:53.291295 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:53.291412 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:53.294864 (+ 3452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:53.294871 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:53.294875 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:53.294914 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:53.298480 (+ 3566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:53.299406 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:53.299411 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:53.299414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:53.299562 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:53.300151 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:53.300155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:53.300158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:53.300643 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:53.300918 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:53.301925 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0809 19:01:53.302123 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":56}
I20260809 19:01:53.307082 19093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:53.316140 19093 catalog_manager.cc:1347] Generated new cluster ID: 2609d189f81643ca81960c7bda6f82a0
I20260809 19:01:53.316233 19093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:53.343262 19093 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:53.345080 19093 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:53.352018 19093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b84e03102544ccf841a8c2890e86517: Generated new TSK 0
I20260809 19:01:53.352995 19093 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:53.366922 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 18966
I20260809 19:01:53.368714 19060 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:53.458899 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 18966
W20260809 19:01:53.484886 18948 connection.cc:535] client connection to 127.16.188.254:38219 recv error: Network error: failed to read from TLS socket (remote: 127.16.188.254:38219): Connection reset by peer (error 104)
2026-08-09T19:01:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2147 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:53 dist-test-slave-266d krb5kdc[19119](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:53 dist-test-slave-266d krb5kdc[19119](info): set up 2 sockets
Aug 09 19:01:53 dist-test-slave-266d krb5kdc[19119](info): commencing operation
krb5kdc: starting...
W20260809 19:01:54.689191 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.003s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:54 dist-test-slave-266d krb5kdc[19119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:01:54.960083 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40745
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:34523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:40745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:55.287824 19139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:55.288094 19139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:55.288233 19139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:55.295228 19139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:55.295341 19139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:55.295418 19139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:55.295499 19139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:55.295557 19139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:55.305044 19139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:34523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:40745
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:40745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:55.306241 19139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:55.307497 19139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:55.318459 19148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:55.318629 19150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:55.318907 19147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:55.319242 19139 server_base.cc:1034] running on GCE node
I20260809 19:01:55.319939 19139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:55.321242 19139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:55.322443 19139 hybrid_clock.cc:648] HybridClock initialized: now 1786302115322391 us; error 44 us; skew 500 ppm
I20260809 19:01:55.322755 19139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:55 dist-test-slave-266d krb5kdc[19119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302115, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:55.325709 19139 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:01:55.327629 19139 webserver.cc:460] Webserver started at http://127.16.188.254:43563/ using document root <none> and password file <none>
I20260809 19:01:55.328244 19139 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:55.328344 19139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:55.328590 19139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:55.331451 19139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "111780c4aef74e4b8b7360d0fa940632"
format_stamp: "Formatted at 2026-08-09 19:01:55 on dist-test-slave-266d"
server_key: "ed2b6fabe922bf3fc33f00d8ea9d22a6"
server_key_iv: "36f5666f341b6ba199a16b4a92a145df"
server_key_version: "encryptionkey@0"
I20260809 19:01:55.332170 19139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "111780c4aef74e4b8b7360d0fa940632"
format_stamp: "Formatted at 2026-08-09 19:01:55 on dist-test-slave-266d"
server_key: "ed2b6fabe922bf3fc33f00d8ea9d22a6"
server_key_iv: "36f5666f341b6ba199a16b4a92a145df"
server_key_version: "encryptionkey@0"
I20260809 19:01:55.337013 19139 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 19:01:55.340210 19161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:55.341459 19139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 19:01:55.341607 19139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "111780c4aef74e4b8b7360d0fa940632"
format_stamp: "Formatted at 2026-08-09 19:01:55 on dist-test-slave-266d"
server_key: "ed2b6fabe922bf3fc33f00d8ea9d22a6"
server_key_iv: "36f5666f341b6ba199a16b4a92a145df"
server_key_version: "encryptionkey@0"
I20260809 19:01:55.341781 19139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:55.360935 19139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:55.365041 19139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:55.365319 19139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:55.382058 19139 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:40745
I20260809 19:01:55.382093 19231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:40745 every 8 connection(s)
I20260809 19:01:55.383330 19139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:55.386849 19233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:55.393652 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19139
I20260809 19:01:55.393828 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:55.394358 17139 external_mini_cluster.cc:1428] Setting key c7014581c3089515e9152af2c0b7088c
I20260809 19:01:55.397204 19233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632: Bootstrap starting.
I20260809 19:01:55.400398 19233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:55.401504 19233 log.cc:824] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:55.404381 19233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632: No bootstrap required, opened a new log
I20260809 19:01:55.407102 19239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:55.396070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45803 (local address 127.16.188.254:40745)
0809 19:01:55.396806 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:55.396816 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:55.396860 (+ 44us) server_negotiation.cc:407] Connection header received
0809 19:01:55.398611 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:55.398636 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:55.398995 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:55.399306 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:55.399870 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:55.401225 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:55.402771 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:55.403436 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:55.403564 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:55.404737 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:55.404744 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:55.404757 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:55.405328 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:55.405396 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:55.405425 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:55.405545 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:55.405913 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 19:01:55.406108 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":334,"threads_started":1}
I20260809 19:01:55.411158 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:55.413285 19233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111780c4aef74e4b8b7360d0fa940632" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40745 } }
I20260809 19:01:55.413720 19233 raft_consensus.cc:374] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:55.413856 19233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 111780c4aef74e4b8b7360d0fa940632, State: Initialized, Role: FOLLOWER
I20260809 19:01:55.414517 19233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111780c4aef74e4b8b7360d0fa940632" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40745 } }
I20260809 19:01:55.414825 19233 raft_consensus.cc:388] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:55.414970 19233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:55.415151 19233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:55.417986 19233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111780c4aef74e4b8b7360d0fa940632" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40745 } }
I20260809 19:01:55.418558 19233 leader_election.cc:302] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 111780c4aef74e4b8b7360d0fa940632; no voters:
I20260809 19:01:55.419235 19233 leader_election.cc:288] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:55.419361 19247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:55.421109 19233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:55.421627 19247 raft_consensus.cc:686] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [term 1 LEADER]: Becoming Leader. State: Replica: 111780c4aef74e4b8b7360d0fa940632, State: Running, Role: LEADER
I20260809 19:01:55.422309 19247 consensus_queue.cc:237] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111780c4aef74e4b8b7360d0fa940632" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40745 } }
I20260809 19:01:55.424654 19239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:55.416593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57681 (local address 127.16.188.254:40745)
0809 19:01:55.416765 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:55.416771 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:55.417289 (+ 518us) server_negotiation.cc:407] Connection header received
0809 19:01:55.417423 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:55.417428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:55.417499 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:55.417585 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:55.418017 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:55.419157 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:55.421162 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:55.421826 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:55.421975 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:55.423485 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:55.423492 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:55.423497 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:55.423521 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:55.423572 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:55.423594 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:55.423705 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:55.424198 (+ 493us) server_negotiation.cc:299] Negotiation successful
0809 19:01:55.424258 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":54}
I20260809 19:01:55.425442 19249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "111780c4aef74e4b8b7360d0fa940632" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111780c4aef74e4b8b7360d0fa940632" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40745 } } }
I20260809 19:01:55.425787 19249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:55.426610 19255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:55.426468 19250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 111780c4aef74e4b8b7360d0fa940632. Latest consensus state: current_term: 1 leader_uuid: "111780c4aef74e4b8b7360d0fa940632" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111780c4aef74e4b8b7360d0fa940632" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 40745 } } }
I20260809 19:01:55.426853 19250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:55.435387 19255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:55.444763 19255 catalog_manager.cc:1347] Generated new cluster ID: e075c00fe29c471cabd5aa10ebbdcaff
I20260809 19:01:55.444871 19255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:55.471127 19255 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:55.472296 19255 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:55.482125 19255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 111780c4aef74e4b8b7360d0fa940632: Generated new TSK 0
I20260809 19:01:55.483201 19255 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:55.498860 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19139
W20260809 19:01:55.500299 19226 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45803
W20260809 19:01:55.500964 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19139: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:55.501082 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19139
W20260809 19:01:55.527808 19114 connection.cc:535] client connection to 127.16.188.254:40745 recv error: Network error: failed to read from TLS socket (remote: 127.16.188.254:40745): Connection reset by peer (error 104)
2026-08-09T19:01:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2042 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:55 dist-test-slave-266d krb5kdc[19275](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:55 dist-test-slave-266d krb5kdc[19275](info): set up 2 sockets
Aug 09 19:01:55 dist-test-slave-266d krb5kdc[19275](info): commencing operation
krb5kdc: starting...
W20260809 19:01:56.729269 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.006s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:56 dist-test-slave-266d krb5kdc[19275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:01:57.002193 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:44843
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:42345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:44843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:57.328313 19293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:57.328593 19293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:57.328724 19293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:57.335840 19293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:57.335950 19293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:57.336030 19293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:57.336112 19293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:57.336174 19293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:57.346006 19293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:42345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:44843
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:44843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:57.347321 19293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:57.348650 19293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:57.360037 19305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:57.359984 19302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:57.360065 19303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:57.360553 19293 server_base.cc:1034] running on GCE node
I20260809 19:01:57.361426 19293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:57.362800 19293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:57.364002 19293 hybrid_clock.cc:648] HybridClock initialized: now 1786302117363947 us; error 50 us; skew 500 ppm
I20260809 19:01:57.364348 19293 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:57 dist-test-slave-266d krb5kdc[19275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302117, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:57.367401 19293 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:01:57.368793 19293 webserver.cc:460] Webserver started at http://127.16.188.254:39863/ using document root <none> and password file <none>
I20260809 19:01:57.369484 19293 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:57.369604 19293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:57.369891 19293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:57.372764 19293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "41f2f5fe061d4aa7a4d381656597c075"
format_stamp: "Formatted at 2026-08-09 19:01:57 on dist-test-slave-266d"
server_key: "4fdae73ce54c238e1aeda1ab60f2c3b2"
server_key_iv: "07ae5149d6d2fff0306353bc6fc5902a"
server_key_version: "encryptionkey@0"
I20260809 19:01:57.373512 19293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "41f2f5fe061d4aa7a4d381656597c075"
format_stamp: "Formatted at 2026-08-09 19:01:57 on dist-test-slave-266d"
server_key: "4fdae73ce54c238e1aeda1ab60f2c3b2"
server_key_iv: "07ae5149d6d2fff0306353bc6fc5902a"
server_key_version: "encryptionkey@0"
I20260809 19:01:57.378576 19293 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 19:01:57.381911 19319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:57.383136 19293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 19:01:57.383302 19293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "41f2f5fe061d4aa7a4d381656597c075"
format_stamp: "Formatted at 2026-08-09 19:01:57 on dist-test-slave-266d"
server_key: "4fdae73ce54c238e1aeda1ab60f2c3b2"
server_key_iv: "07ae5149d6d2fff0306353bc6fc5902a"
server_key_version: "encryptionkey@0"
I20260809 19:01:57.383477 19293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:57.388895 19293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:57.392572 19293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:57.392828 19293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:57.409581 19293 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:44843
I20260809 19:01:57.409621 19392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:44843 every 8 connection(s)
I20260809 19:01:57.410840 19293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:57.414371 19393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:57.416141 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19293
I20260809 19:01:57.416303 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:57.416751 17139 external_mini_cluster.cc:1428] Setting key 65f0cd16cf6609a430c78b814ad8e998
I20260809 19:01:57.423823 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:57.418383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44159 (local address 127.16.188.254:44843)
0809 19:01:57.419159 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:57.419170 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:57.419213 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:01:57.420749 (+ 1536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:57.420782 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:57.421085 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:57.421422 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:57.422409 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:57.422416 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:57.422428 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:57.422442 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:57.422493 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:57.422512 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:57.422672 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:57.422783 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 19:01:57.422944 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":354,"threads_started":1}
I20260809 19:01:57.427209 19393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075: Bootstrap starting.
I20260809 19:01:57.427285 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:57.430092 19393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:57.431157 19393 log.cc:824] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:57.433499 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:57.431196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40741 (local address 127.16.188.254:44843)
0809 19:01:57.431403 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:57.431409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:57.431869 (+ 460us) server_negotiation.cc:407] Connection header received
0809 19:01:57.431993 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:57.431997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:57.432052 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:57.432187 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:57.432925 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:57.432929 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:57.432932 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:01:57.432945 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:57.432979 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:01:57.432991 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:57.433067 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:57.433213 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 19:01:57.433253 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260809 19:01:57.434168 19393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075: No bootstrap required, opened a new log
I20260809 19:01:57.440878 19393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f2f5fe061d4aa7a4d381656597c075" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44843 } }
I20260809 19:01:57.441236 19393 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:57.441320 19393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f2f5fe061d4aa7a4d381656597c075, State: Initialized, Role: FOLLOWER
I20260809 19:01:57.441820 19393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f2f5fe061d4aa7a4d381656597c075" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44843 } }
I20260809 19:01:57.442035 19393 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:57.442164 19393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:57.442314 19393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:57.444540 19393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f2f5fe061d4aa7a4d381656597c075" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44843 } }
I20260809 19:01:57.445003 19393 leader_election.cc:302] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41f2f5fe061d4aa7a4d381656597c075; no voters:
I20260809 19:01:57.445539 19393 leader_election.cc:288] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:57.445647 19408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:57.446270 19408 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [term 1 LEADER]: Becoming Leader. State: Replica: 41f2f5fe061d4aa7a4d381656597c075, State: Running, Role: LEADER
I20260809 19:01:57.446791 19408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f2f5fe061d4aa7a4d381656597c075" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44843 } }
I20260809 19:01:57.447428 19393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:57.449417 19410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41f2f5fe061d4aa7a4d381656597c075. Latest consensus state: current_term: 1 leader_uuid: "41f2f5fe061d4aa7a4d381656597c075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f2f5fe061d4aa7a4d381656597c075" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44843 } } }
I20260809 19:01:57.449862 19410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:57.450233 19409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41f2f5fe061d4aa7a4d381656597c075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f2f5fe061d4aa7a4d381656597c075" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 44843 } } }
I20260809 19:01:57.450598 19409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075 [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:57.451678 19416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:57.456398 19416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:57.463758 19416 catalog_manager.cc:1347] Generated new cluster ID: 43844ec1577d4702a798a18495e827ed
I20260809 19:01:57.463861 19416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:57.487910 19416 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:57.488308 19416 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:57.497185 19416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41f2f5fe061d4aa7a4d381656597c075: Generated new TSK 0
I20260809 19:01:57.497920 19416 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:57.507725 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19293
W20260809 19:01:57.509167 19387 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44159
W20260809 19:01:57.509796 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19293: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:01:57.509922 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19293
2026-08-09T19:01:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2010 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:57 dist-test-slave-266d krb5kdc[19445](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:57 dist-test-slave-266d krb5kdc[19445](info): set up 2 sockets
Aug 09 19:01:57 dist-test-slave-266d krb5kdc[19445](info): commencing operation
krb5kdc: starting...
W20260809 19:01:58.760846 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.003s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:01:58 dist-test-slave-266d krb5kdc[19445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:01:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:01:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:01:59.037917 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:41255
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:38703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:41255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:01:59.363543 19464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:01:59.363839 19464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:01:59.363976 19464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:01:59.370950 19464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:01:59.371060 19464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:01:59.371137 19464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:01:59.371228 19464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:01:59.371284 19464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:01:59.380668 19464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:38703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:41255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:41255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:01:59.381877 19464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:01:59.383131 19464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:01:59.394591 19470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:59.394651 19474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:01:59.394588 19471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:01:59.398352 19464 server_base.cc:1034] running on GCE node
I20260809 19:01:59.399091 19464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:01:59.400419 19464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:01:59.401633 19464 hybrid_clock.cc:648] HybridClock initialized: now 1786302119401577 us; error 41 us; skew 500 ppm
I20260809 19:01:59.401983 19464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:01:59 dist-test-slave-266d krb5kdc[19445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302119, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:01:59.405041 19464 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:01:59.406548 19464 webserver.cc:460] Webserver started at http://127.16.188.254:45047/ using document root <none> and password file <none>
I20260809 19:01:59.407239 19464 fs_manager.cc:359] Metadata directory not provided
I20260809 19:01:59.407362 19464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:01:59.407672 19464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:01:59.410708 19464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "fa1a4a946a7f4ee19673c53de9d87eec"
format_stamp: "Formatted at 2026-08-09 19:01:59 on dist-test-slave-266d"
server_key: "2a72d45560c9c1be542cc56627bcba39"
server_key_iv: "a52dfff390d78d1c55e3921f7c218387"
server_key_version: "encryptionkey@0"
I20260809 19:01:59.411489 19464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "fa1a4a946a7f4ee19673c53de9d87eec"
format_stamp: "Formatted at 2026-08-09 19:01:59 on dist-test-slave-266d"
server_key: "2a72d45560c9c1be542cc56627bcba39"
server_key_iv: "a52dfff390d78d1c55e3921f7c218387"
server_key_version: "encryptionkey@0"
I20260809 19:01:59.416618 19464 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 19:01:59.420128 19484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:01:59.421409 19464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:01:59.421576 19464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "fa1a4a946a7f4ee19673c53de9d87eec"
format_stamp: "Formatted at 2026-08-09 19:01:59 on dist-test-slave-266d"
server_key: "2a72d45560c9c1be542cc56627bcba39"
server_key_iv: "a52dfff390d78d1c55e3921f7c218387"
server_key_version: "encryptionkey@0"
I20260809 19:01:59.421756 19464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:01:59.432420 19464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:01:59.436136 19464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:01:59.436424 19464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:01:59.454723 19464 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:41255
I20260809 19:01:59.454725 19551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:41255 every 8 connection(s)
I20260809 19:01:59.456102 19464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:01:59.459656 19555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:01:59.460824 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19464
I20260809 19:01:59.460983 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:01:59.461470 17139 external_mini_cluster.cc:1428] Setting key 0058fe7f4ae3eb947e06ef4c0d969013
I20260809 19:01:59.472718 19555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec: Bootstrap starting.
Aug 09 19:01:59 dist-test-slave-266d krb5kdc[19445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:01:59.476255 19555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec: Neither blocks nor log segments found. Creating new log.
I20260809 19:01:59.477257 19555 log.cc:824] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec: Log is configured to *not* fsync() on all Append() calls
I20260809 19:01:59.479864 19555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec: No bootstrap required, opened a new log
I20260809 19:01:59.484534 19558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:59.463315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47065 (local address 127.16.188.254:41255)
0809 19:01:59.464190 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:59.464201 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:59.464253 (+ 52us) server_negotiation.cc:407] Connection header received
0809 19:01:59.465918 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:59.465944 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:59.466339 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:59.466651 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:59.468404 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:59.469880 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:59.471659 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:59.472340 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:59.472483 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:59.477180 (+ 4697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:59.477190 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:59.477205 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:59.477251 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:59.480315 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:59.481015 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:59.481022 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:59.481027 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:59.481286 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:59.481714 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:59.481719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:59.481721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:59.482292 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:59.482606 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:59.483119 (+ 513us) server_negotiation.cc:299] Negotiation successful
0809 19:01:59.483511 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":400,"threads_started":1}
I20260809 19:01:59.487340 19555 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a4a946a7f4ee19673c53de9d87eec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41255 } }
I20260809 19:01:59.487676 19555 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:01:59.487769 19555 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1a4a946a7f4ee19673c53de9d87eec, State: Initialized, Role: FOLLOWER
I20260809 19:01:59.488221 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:01:59.488324 19555 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a4a946a7f4ee19673c53de9d87eec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41255 } }
I20260809 19:01:59.488561 19555 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:01:59.488679 19555 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:01:59.488817 19555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:01:59.491789 19555 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a4a946a7f4ee19673c53de9d87eec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41255 } }
I20260809 19:01:59.492370 19555 leader_election.cc:302] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa1a4a946a7f4ee19673c53de9d87eec; no voters:
I20260809 19:01:59.492961 19555 leader_election.cc:288] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:01:59.493053 19567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:01:59.495026 19555 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:01:59.497517 19567 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [term 1 LEADER]: Becoming Leader. State: Replica: fa1a4a946a7f4ee19673c53de9d87eec, State: Running, Role: LEADER
I20260809 19:01:59.498235 19567 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a4a946a7f4ee19673c53de9d87eec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41255 } }
I20260809 19:01:59.500826 19570 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa1a4a946a7f4ee19673c53de9d87eec. Latest consensus state: current_term: 1 leader_uuid: "fa1a4a946a7f4ee19673c53de9d87eec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a4a946a7f4ee19673c53de9d87eec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41255 } } }
I20260809 19:01:59.501547 19570 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:59.501068 19569 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa1a4a946a7f4ee19673c53de9d87eec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a4a946a7f4ee19673c53de9d87eec" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 41255 } } }
I20260809 19:01:59.502247 19569 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec [sys.catalog]: This master's current role is: LEADER
I20260809 19:01:59.502475 19586 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:01:59.512290 19586 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:01:59.515198 19558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:01:59.494051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51925 (local address 127.16.188.254:41255)
0809 19:01:59.494204 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 19:01:59.494209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:01:59.497271 (+ 3062us) server_negotiation.cc:407] Connection header received
0809 19:01:59.497458 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:01:59.497464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:01:59.497552 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:01:59.497665 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:01:59.499847 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:59.501049 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:59.502979 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:01:59.503701 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:01:59.503820 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:01:59.507297 (+ 3477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:01:59.507305 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:01:59.507311 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:01:59.507357 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:01:59.511487 (+ 4130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:59.512452 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:59.512459 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:59.512464 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:59.512635 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:01:59.513192 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:01:59.513197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:01:59.513201 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:01:59.513649 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:01:59.513883 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 19:01:59.514549 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 19:01:59.514797 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 19:01:59.523053 19586 catalog_manager.cc:1347] Generated new cluster ID: ff47c87d1546459db3f33f6436157a16
I20260809 19:01:59.523152 19586 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:01:59.541657 19586 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:01:59.542970 19586 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:01:59.552129 19586 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa1a4a946a7f4ee19673c53de9d87eec: Generated new TSK 0
I20260809 19:01:59.552937 19586 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:01:59.558588 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19464
I20260809 19:01:59.560057 19546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:01:59.648986 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19464
2026-08-09T19:01:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2133 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:01:59 dist-test-slave-266d krb5kdc[19601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:01:59 dist-test-slave-266d krb5kdc[19601](info): set up 2 sockets
Aug 09 19:01:59 dist-test-slave-266d krb5kdc[19601](info): commencing operation
krb5kdc: starting...
W20260809 19:02:00.866647 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.006s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:02:01 dist-test-slave-266d krb5kdc[19601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:02:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:02:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:02:01.141463 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:34079
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:37331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:34079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:02:01.464978 19622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:02:01.465256 19622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:02:01.465389 19622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:02:01.472293 19622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:02:01.472390 19622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:02:01.472461 19622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:02:01.472543 19622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:02:01.472604 19622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:02:01.481951 19622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:37331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:34079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:34079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:02:01.483107 19622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:02:01.484368 19622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:02:01.495564 19627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:01.495555 19628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:01.495529 19631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:02:01.496420 19622 server_base.cc:1034] running on GCE node
I20260809 19:02:01.497225 19622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:02:01.498508 19622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:02:01.499694 19622 hybrid_clock.cc:648] HybridClock initialized: now 1786302121499652 us; error 37 us; skew 500 ppm
I20260809 19:02:01.500010 19622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:02:01 dist-test-slave-266d krb5kdc[19601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302121, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:02:01.502913 19622 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:02:01.504276 19622 webserver.cc:460] Webserver started at http://127.16.188.254:46651/ using document root <none> and password file <none>
I20260809 19:02:01.504904 19622 fs_manager.cc:359] Metadata directory not provided
I20260809 19:02:01.505014 19622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:02:01.505344 19622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:02:01.508173 19622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "b4d6805ca4174afc9dc017843e3c8c2a"
format_stamp: "Formatted at 2026-08-09 19:02:01 on dist-test-slave-266d"
server_key: "25d9eb9bd5d0c9625602d41f453c75c8"
server_key_iv: "5285f95ba47c799e68ecf69315360711"
server_key_version: "encryptionkey@0"
I20260809 19:02:01.508888 19622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "b4d6805ca4174afc9dc017843e3c8c2a"
format_stamp: "Formatted at 2026-08-09 19:02:01 on dist-test-slave-266d"
server_key: "25d9eb9bd5d0c9625602d41f453c75c8"
server_key_iv: "5285f95ba47c799e68ecf69315360711"
server_key_version: "encryptionkey@0"
I20260809 19:02:01.513644 19622 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 19:02:01.516837 19639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:02:01.518060 19622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:02:01.518200 19622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "b4d6805ca4174afc9dc017843e3c8c2a"
format_stamp: "Formatted at 2026-08-09 19:02:01 on dist-test-slave-266d"
server_key: "25d9eb9bd5d0c9625602d41f453c75c8"
server_key_iv: "5285f95ba47c799e68ecf69315360711"
server_key_version: "encryptionkey@0"
I20260809 19:02:01.518360 19622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:02:01.535593 19622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:02:01.539332 19622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:02:01.539577 19622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:02:01.556905 19622 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:34079
I20260809 19:02:01.556939 19713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:34079 every 8 connection(s)
I20260809 19:02:01.558259 19622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:02:01.561895 19714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:02:01.564407 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19622
I20260809 19:02:01.564587 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:02:01.565155 17139 external_mini_cluster.cc:1428] Setting key 0ff3c1b1fffae3487c28fe356f165fe2
I20260809 19:02:01.573706 19714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a: Bootstrap starting.
I20260809 19:02:01.577180 19714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a: Neither blocks nor log segments found. Creating new log.
I20260809 19:02:01.578002 19718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:01.566942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40129 (local address 127.16.188.254:34079)
0809 19:02:01.567769 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:01.567780 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:01.567823 (+ 43us) server_negotiation.cc:407] Connection header received
0809 19:02:01.569485 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:01.569508 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:01.569874 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:01.570174 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:01.570766 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:01.572074 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:01.573879 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:01.574515 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:01.574638 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:01.575842 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:01.575850 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:01.575862 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:02:01.576367 (+ 505us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:01.576439 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:02:01.576463 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:01.576550 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:01.576756 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 19:02:01.576983 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":359,"threads_started":1}
I20260809 19:02:01.578265 19714 log.cc:824] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a: Log is configured to *not* fsync() on all Append() calls
I20260809 19:02:01.581286 19714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a: No bootstrap required, opened a new log
I20260809 19:02:01.581656 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:02:01.590775 19714 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4d6805ca4174afc9dc017843e3c8c2a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34079 } }
I20260809 19:02:01.591250 19714 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:02:01.591392 19714 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4d6805ca4174afc9dc017843e3c8c2a, State: Initialized, Role: FOLLOWER
I20260809 19:02:01.591995 19714 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4d6805ca4174afc9dc017843e3c8c2a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34079 } }
I20260809 19:02:01.592255 19714 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:02:01.592403 19714 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:02:01.592592 19714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:02:01.592952 19718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:01.586682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52775 (local address 127.16.188.254:34079)
0809 19:02:01.586860 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:01.586865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:01.587252 (+ 387us) server_negotiation.cc:407] Connection header received
0809 19:02:01.587412 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:01.587416 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:01.587495 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:01.587611 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:01.588062 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:01.589209 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:01.590462 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:01.591093 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:01.591223 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:01.592229 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:01.592235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:01.592239 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:02:01.592263 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:01.592308 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:02:01.592330 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:01.592440 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:01.592550 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 19:02:01.592651 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:02:01.595280 19714 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4d6805ca4174afc9dc017843e3c8c2a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34079 } }
I20260809 19:02:01.595715 19714 leader_election.cc:302] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4d6805ca4174afc9dc017843e3c8c2a; no voters:
I20260809 19:02:01.596236 19714 leader_election.cc:288] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:02:01.596356 19728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:02:01.597029 19728 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [term 1 LEADER]: Becoming Leader. State: Replica: b4d6805ca4174afc9dc017843e3c8c2a, State: Running, Role: LEADER
I20260809 19:02:01.597599 19728 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4d6805ca4174afc9dc017843e3c8c2a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34079 } }
I20260809 19:02:01.598289 19714 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:02:01.600283 19730 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4d6805ca4174afc9dc017843e3c8c2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4d6805ca4174afc9dc017843e3c8c2a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34079 } } }
I20260809 19:02:01.600636 19730 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:01.601542 19739 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:02:01.601481 19735 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4d6805ca4174afc9dc017843e3c8c2a. Latest consensus state: current_term: 1 leader_uuid: "b4d6805ca4174afc9dc017843e3c8c2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4d6805ca4174afc9dc017843e3c8c2a" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 34079 } } }
I20260809 19:02:01.601858 19735 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:01.609794 19739 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:02:01.627408 19739 catalog_manager.cc:1347] Generated new cluster ID: d5760e8ea4e344dbac55a74e761dc0b6
I20260809 19:02:01.627522 19739 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:02:01.634637 19739 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:02:01.636333 19739 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:02:01.644172 19739 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4d6805ca4174afc9dc017843e3c8c2a: Generated new TSK 0
I20260809 19:02:01.644881 19739 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:02:01.657634 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19622
W20260809 19:02:01.658869 19705 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:40129
W20260809 19:02:01.659475 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19622: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:02:01.659596 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19622
2026-08-09T19:02:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2013 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:02:01 dist-test-slave-266d krb5kdc[19761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:02:01 dist-test-slave-266d krb5kdc[19761](info): set up 2 sockets
Aug 09 19:02:01 dist-test-slave-266d krb5kdc[19761](info): commencing operation
krb5kdc: starting...
W20260809 19:02:02.909929 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:02:03 dist-test-slave-266d krb5kdc[19761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:02:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:02:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:02:03.194214 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:42599
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:34073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:42599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:02:03.527140 19778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:02:03.527431 19778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:02:03.527549 19778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:02:03.534459 19778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:02:03.534560 19778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:02:03.534613 19778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:02:03.534679 19778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:02:03.534722 19778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:02:03.544209 19778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:34073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:42599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:42599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:02:03.545476 19778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:02:03.546758 19778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:02:03.561679 19787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:03.561761 19789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:03.562023 19784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:02:03.562752 19778 server_base.cc:1034] running on GCE node
I20260809 19:02:03.563450 19778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:02:03.564742 19778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:02:03.565956 19778 hybrid_clock.cc:648] HybridClock initialized: now 1786302123565903 us; error 30 us; skew 500 ppm
I20260809 19:02:03.566344 19778 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:02:03 dist-test-slave-266d krb5kdc[19761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302123, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:02:03.573032 19778 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:02:03.574477 19778 webserver.cc:460] Webserver started at http://127.16.188.254:39469/ using document root <none> and password file <none>
I20260809 19:02:03.575086 19778 fs_manager.cc:359] Metadata directory not provided
I20260809 19:02:03.575188 19778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:02:03.575446 19778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:02:03.578361 19778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "786fa411f42b4b9bb2160468a91fe6d7"
format_stamp: "Formatted at 2026-08-09 19:02:03 on dist-test-slave-266d"
server_key: "d29e2bdfffd3b3ef2250180e818ad216"
server_key_iv: "22160333b2a453f43ee3a0e709e14838"
server_key_version: "encryptionkey@0"
I20260809 19:02:03.579038 19778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "786fa411f42b4b9bb2160468a91fe6d7"
format_stamp: "Formatted at 2026-08-09 19:02:03 on dist-test-slave-266d"
server_key: "d29e2bdfffd3b3ef2250180e818ad216"
server_key_iv: "22160333b2a453f43ee3a0e709e14838"
server_key_version: "encryptionkey@0"
I20260809 19:02:03.583877 19778 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 19:02:03.587077 19798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:02:03.588291 19778 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:02:03.588450 19778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "786fa411f42b4b9bb2160468a91fe6d7"
format_stamp: "Formatted at 2026-08-09 19:02:03 on dist-test-slave-266d"
server_key: "d29e2bdfffd3b3ef2250180e818ad216"
server_key_iv: "22160333b2a453f43ee3a0e709e14838"
server_key_version: "encryptionkey@0"
I20260809 19:02:03.588629 19778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:02:03.593943 19778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:02:03.598021 19778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:02:03.598291 19778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:02:03.614904 19778 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:42599
I20260809 19:02:03.614938 19875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:42599 every 8 connection(s)
I20260809 19:02:03.616151 19778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:02:03.619012 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19778
I20260809 19:02:03.619194 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:02:03.619769 17139 external_mini_cluster.cc:1428] Setting key f8b401f5d5f999c5087a3224aba0f83c
I20260809 19:02:03.620005 19877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:02:03.627440 19883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:03.621480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60181 (local address 127.16.188.254:42599)
0809 19:02:03.622219 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:03.622230 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:03.622272 (+ 42us) server_negotiation.cc:407] Connection header received
0809 19:02:03.624415 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:03.624435 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:03.624753 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:03.625057 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:03.626061 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:03.626067 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:03.626079 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:02:03.626095 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:03.626150 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:02:03.626172 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:03.626336 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:03.626427 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 19:02:03.626586 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":348,"threads_started":1}
I20260809 19:02:03.630934 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:02:03.632721 19877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7: Bootstrap starting.
I20260809 19:02:03.635924 19877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7: Neither blocks nor log segments found. Creating new log.
I20260809 19:02:03.637154 19883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:03.634984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40993 (local address 127.16.188.254:42599)
0809 19:02:03.635145 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:03.635150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:03.635472 (+ 322us) server_negotiation.cc:407] Connection header received
0809 19:02:03.635620 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:03.635623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:03.635664 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:03.635734 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:03.636580 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:03.636584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:03.636587 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 19:02:03.636600 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:03.636634 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 19:02:03.636646 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:03.636726 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:03.636842 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 19:02:03.636886 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:02:03.637233 19877 log.cc:824] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7: Log is configured to *not* fsync() on all Append() calls
I20260809 19:02:03.639850 19877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7: No bootstrap required, opened a new log
I20260809 19:02:03.646718 19877 raft_consensus.cc:348] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786fa411f42b4b9bb2160468a91fe6d7" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42599 } }
I20260809 19:02:03.647042 19877 raft_consensus.cc:374] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 19:02:03.647138 19877 raft_consensus.cc:729] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786fa411f42b4b9bb2160468a91fe6d7, State: Initialized, Role: FOLLOWER
I20260809 19:02:03.647634 19877 consensus_queue.cc:260] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786fa411f42b4b9bb2160468a91fe6d7" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42599 } }
I20260809 19:02:03.647836 19877 raft_consensus.cc:388] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 19:02:03.647964 19877 raft_consensus.cc:482] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 19:02:03.648123 19877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:02:03.650202 19877 raft_consensus.cc:504] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786fa411f42b4b9bb2160468a91fe6d7" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42599 } }
I20260809 19:02:03.650636 19877 leader_election.cc:302] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 786fa411f42b4b9bb2160468a91fe6d7; no voters:
I20260809 19:02:03.651170 19877 leader_election.cc:288] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 19:02:03.651296 19891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:02:03.651901 19891 raft_consensus.cc:686] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [term 1 LEADER]: Becoming Leader. State: Replica: 786fa411f42b4b9bb2160468a91fe6d7, State: Running, Role: LEADER
I20260809 19:02:03.652390 19891 consensus_queue.cc:237] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786fa411f42b4b9bb2160468a91fe6d7" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42599 } }
I20260809 19:02:03.653028 19877 sys_catalog.cc:564] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:02:03.655157 19894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 786fa411f42b4b9bb2160468a91fe6d7. Latest consensus state: current_term: 1 leader_uuid: "786fa411f42b4b9bb2160468a91fe6d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786fa411f42b4b9bb2160468a91fe6d7" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42599 } } }
I20260809 19:02:03.655212 19892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "786fa411f42b4b9bb2160468a91fe6d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786fa411f42b4b9bb2160468a91fe6d7" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42599 } } }
I20260809 19:02:03.655704 19892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:03.655704 19894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7 [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:03.656613 19901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:02:03.664623 19901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 19:02:03.672698 19901 catalog_manager.cc:1347] Generated new cluster ID: 1d01ba3b0b8e488384f7d96030e975d0
I20260809 19:02:03.672799 19901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:02:03.704430 19901 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:02:03.704902 19901 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:02:03.718537 19901 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 786fa411f42b4b9bb2160468a91fe6d7: Generated new TSK 0
I20260809 19:02:03.719439 19901 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:02:03.727340 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19778
W20260809 19:02:03.728406 19869 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60181
W20260809 19:02:03.729108 17139 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19778: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 19:02:03.729247 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19778
2026-08-09T19:02:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2068 ms)
[----------] 18 tests from AuthTokenIssuingTest (37751 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:02:03 dist-test-slave-266d krb5kdc[19918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:02:03 dist-test-slave-266d krb5kdc[19918](info): set up 2 sockets
Aug 09 19:02:03 dist-test-slave-266d krb5kdc[19918](info): commencing operation
krb5kdc: starting...
W20260809 19:02:04.958745 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:02:05 dist-test-slave-266d krb5kdc[19918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:02:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:02:05.265828 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:42627
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:42627,127.16.188.253:44839,127.16.188.252:45893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:02:05.602494 19936 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:02:05.602811 19936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:02:05.602953 19936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:02:05.603088 19936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:02:05.610133 19936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:02:05.610220 19936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:02:05.610307 19936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:02:05.610374 19936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:02:05.610459 19936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:02:05.619889 19936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:42627,127.16.188.253:44839,127.16.188.252:45893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:42627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:02:05.621068 19936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:02:05.622361 19936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:02:05.633585 19942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:05.633633 19948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:05.633549 19945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:02:05.634478 19936 server_base.cc:1034] running on GCE node
I20260809 19:02:05.635215 19936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:02:05.636533 19936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:02:05.637748 19936 hybrid_clock.cc:648] HybridClock initialized: now 1786302125637683 us; error 33 us; skew 500 ppm
I20260809 19:02:05.638046 19936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:02:05 dist-test-slave-266d krb5kdc[19918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302125, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:02:05.641021 19936 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:02:05.642375 19936 webserver.cc:460] Webserver started at http://127.16.188.254:32933/ using document root <none> and password file <none>
I20260809 19:02:05.643008 19936 fs_manager.cc:359] Metadata directory not provided
I20260809 19:02:05.643105 19936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:02:05.643409 19936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:02:05.646258 19936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "ab15e952001b42a098ef91101a5b11f3"
format_stamp: "Formatted at 2026-08-09 19:02:05 on dist-test-slave-266d"
server_key: "d85d7761d457ed230916fb5bb41bfe1d"
server_key_iv: "e8ddf62bf93ce3510eaaf5591d33e924"
server_key_version: "encryptionkey@0"
I20260809 19:02:05.647055 19936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "ab15e952001b42a098ef91101a5b11f3"
format_stamp: "Formatted at 2026-08-09 19:02:05 on dist-test-slave-266d"
server_key: "d85d7761d457ed230916fb5bb41bfe1d"
server_key_iv: "e8ddf62bf93ce3510eaaf5591d33e924"
server_key_version: "encryptionkey@0"
I20260809 19:02:05.651775 19936 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 19:02:05.654996 19959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:02:05.656236 19936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 19:02:05.656419 19936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "ab15e952001b42a098ef91101a5b11f3"
format_stamp: "Formatted at 2026-08-09 19:02:05 on dist-test-slave-266d"
server_key: "d85d7761d457ed230916fb5bb41bfe1d"
server_key_iv: "e8ddf62bf93ce3510eaaf5591d33e924"
server_key_version: "encryptionkey@0"
I20260809 19:02:05.656600 19936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:02:05.679282 19936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:02:05.682824 19936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:02:05.683053 19936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:02:05.700089 19936 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:42627
I20260809 19:02:05.700137 20035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:42627 every 8 connection(s)
I20260809 19:02:05.701327 19936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:02:05.705065 20038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:02:05.705516 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 19936
I20260809 19:02:05.705773 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:02:05.706683 17139 external_mini_cluster.cc:1428] Setting key f2775d4bfe7dc709233cd1719e31d437
I20260809 19:02:05.714041 20038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:05 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302125, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:02:05.737286 20044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.717618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35078 (local address 127.16.188.254:42627)
0809 19:02:05.719144 (+ 1526us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:05.719152 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:05.719205 (+ 53us) server_negotiation.cc:407] Connection header received
0809 19:02:05.720699 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:05.720703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:05.720902 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:05.721077 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:05.722380 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:05.723631 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:05.725530 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:05.726112 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:05.726248 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:05.730196 (+ 3948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:05.730205 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:05.730217 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:05.730249 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:05.733085 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:05.733922 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:05.733928 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:05.733931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:05.734102 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:05.734525 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:05.734528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:05.734530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:05.735016 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:05.735205 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:05.735860 (+ 655us) server_negotiation.cc:299] Negotiation successful
0809 19:02:05.736154 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1321,"thread_start_us":1118,"threads_started":1}
I20260809 19:02:05.737314 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.717618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:42627 (local address 127.0.0.1:35078)
0809 19:02:05.718438 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.718488 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:05.720355 (+ 1867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:05.721135 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:05.721142 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:05.721803 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:05.722114 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:05.722130 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:05.723809 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:05.723814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:05.725393 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:05.725408 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:05.726398 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:05.726410 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:05.726574 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:05.727227 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:05.727260 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:05.729936 (+ 2676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:05.733257 (+ 3321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:05.733270 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:05.733282 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:05.733792 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:05.734216 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:05.734221 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:05.734224 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:05.734422 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:05.735185 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:05.735193 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:05.735448 (+ 255us) client_negotiation.cc:769] Sending connection context
0809 19:02:05.735726 (+ 278us) client_negotiation.cc:240] Negotiation successful
0809 19:02:05.736334 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":119,"thread_start_us":325,"threads_started":1}
WARNING: no policy specified for kudu/127.16.188.253@KRBTEST.COM; defaulting to no policy
I20260809 19:02:05.740231 20038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:02:05.741178 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.740784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34826)
0809 19:02:05.740925 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.741026 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 19:02:05.741427 19965 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.253@KRBTEST.COM" created.
I20260809 19:02:05.742957 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.742592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34828)
0809 19:02:05.742744 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.742823 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 19:02:05.743134 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:44839: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab.
Entry for principal kudu/127.16.188.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab.
I20260809 19:02:05.774273 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.253:44839
--webserver_interface=127.16.188.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab
--principal=kudu/127.16.188.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:42627,127.16.188.253:44839,127.16.188.252:45893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:02:05.792461 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } attempt: 1
I20260809 19:02:05.793654 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.793198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34834)
0809 19:02:05.793387 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.793504 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 19:02:05.794727 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.794368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34850)
0809 19:02:05.794507 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.794578 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:02:05.794929 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:44839: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
I20260809 19:02:05.863166 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } attempt: 2
I20260809 19:02:05.864429 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.863907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34862)
0809 19:02:05.864170 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.864275 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 19:02:05.865640 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.865163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34866)
0809 19:02:05.865346 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.865458 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 19:02:05.865868 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:44839: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
I20260809 19:02:05.957202 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } attempt: 3
I20260809 19:02:05.958523 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.957968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34874)
0809 19:02:05.958216 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.958341 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 19:02:05.959663 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:05.959203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34888)
0809 19:02:05.959383 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:05.959477 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 19:02:05.959874 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:44839: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
W20260809 19:02:06.100363 20049 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:02:06.100659 20049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:02:06.100730 20049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:02:06.100808 20049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 19:02:06.103094 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } attempt: 4
I20260809 19:02:06.104308 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.103696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34898)
0809 19:02:06.104028 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.104138 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
I20260809 19:02:06.105357 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.104932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34902)
0809 19:02:06.105107 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.105206 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 19:02:06.105576 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:44839: Network error: Client connection negotiation failed: client connection to 127.16.188.253:44839: connect: Connection refused (error 111)
W20260809 19:02:06.108186 20049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:02:06.108269 20049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:02:06.108335 20049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:02:06.108385 20049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:02:06.108467 20049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:02:06.117915 20049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:42627,127.16.188.253:44839,127.16.188.252:45893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab
--principal=kudu/127.16.188.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.253:44839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.188.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:02:06.119097 20049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:02:06.120289 20049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:02:06.130934 20056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:06.130944 20057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:06.130959 20059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:02:06.131682 20049 server_base.cc:1034] running on GCE node
I20260809 19:02:06.132331 20049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:02:06.133596 20049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:02:06.134807 20049 hybrid_clock.cc:648] HybridClock initialized: now 1786302126134739 us; error 34 us; skew 500 ppm
I20260809 19:02:06.135107 20049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:02:06.138073 20049 init.cc:377] Logged in from keytab as kudu/127.16.188.253@KRBTEST.COM (short username kudu)
I20260809 19:02:06.139366 20049 webserver.cc:460] Webserver started at http://127.16.188.253:40873/ using document root <none> and password file <none>
I20260809 19:02:06.139992 20049 fs_manager.cc:359] Metadata directory not provided
I20260809 19:02:06.140081 20049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:02:06.140367 20049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:02:06.143146 20049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/data/instance:
uuid: "61c1f1a89ba649808178ed835405bd92"
format_stamp: "Formatted at 2026-08-09 19:02:06 on dist-test-slave-266d"
server_key: "40ec71f3482ce7fe6fc740bfa87b84ce"
server_key_iv: "7c8b4ff411732d0ba692e53962958563"
server_key_version: "encryptionkey@0"
I20260809 19:02:06.143899 20049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/wal/instance:
uuid: "61c1f1a89ba649808178ed835405bd92"
format_stamp: "Formatted at 2026-08-09 19:02:06 on dist-test-slave-266d"
server_key: "40ec71f3482ce7fe6fc740bfa87b84ce"
server_key_iv: "7c8b4ff411732d0ba692e53962958563"
server_key_version: "encryptionkey@0"
I20260809 19:02:06.148589 20049 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260809 19:02:06.151731 20069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:02:06.152880 20049 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 19:02:06.153028 20049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/wal
uuid: "61c1f1a89ba649808178ed835405bd92"
format_stamp: "Formatted at 2026-08-09 19:02:06 on dist-test-slave-266d"
server_key: "40ec71f3482ce7fe6fc740bfa87b84ce"
server_key_iv: "7c8b4ff411732d0ba692e53962958563"
server_key_version: "encryptionkey@0"
I20260809 19:02:06.153259 20049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:02:06.170310 20049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:02:06.174070 20049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:02:06.174333 20049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:02:06.191846 20049 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.253:44839
I20260809 19:02:06.191852 20133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.253:44839 every 8 connection(s)
I20260809 19:02:06.193184 20049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
I20260809 19:02:06.196710 20134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:02:06.199883 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20049
I20260809 19:02:06.200075 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-1/wal/instance
I20260809 19:02:06.200616 17139 external_mini_cluster.cc:1428] Setting key 6ac65bd96206cdd445ed6a958251aee4
I20260809 19:02:06.204257 20134 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:02:06.224416 20044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.207115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35094 (local address 127.16.188.254:42627)
0809 19:02:06.207336 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.207344 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.208580 (+ 1236us) server_negotiation.cc:407] Connection header received
0809 19:02:06.210534 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.210540 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.210621 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.210729 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.212188 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.213084 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.214637 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.215037 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.215139 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.219009 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.219014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.219017 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.219048 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.221632 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.222291 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.222296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.222298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.222410 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.222798 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.222803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.222806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.223067 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.223211 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.223877 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.224093 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:02:06.225294 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.207597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:42627 (local address 127.0.0.1:35094)
0809 19:02:06.208399 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.208445 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:06.210263 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:06.210909 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:06.210916 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:06.211429 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:06.211992 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.212011 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.213251 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.213256 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.214469 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.214483 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.215259 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.215268 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.215571 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.216290 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:06.216338 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:06.218806 (+ 2468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:06.221766 (+ 2960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.221776 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.221790 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.222179 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.222512 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.222516 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.222520 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.222694 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.223204 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:06.223212 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:06.223509 (+ 297us) client_negotiation.cc:769] Sending connection context
0809 19:02:06.223754 (+ 245us) client_negotiation.cc:240] Negotiation successful
0809 19:02:06.224197 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":331,"threads_started":1}
I20260809 19:02:06.226779 20134 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.188.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.252@KRBTEST.COM" created.
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 19:02:06.241671 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.227463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34904)
0809 19:02:06.227645 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.227667 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:06.227780 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:06.228520 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:06.228527 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:06.228983 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:06.229219 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.229233 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.230583 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.230590 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.231951 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.231969 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.232858 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.232867 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.232996 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.233549 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:06.233580 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:06.235901 (+ 2321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:06.239505 (+ 3604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.239509 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.239511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.239846 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.240211 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.240213 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.240216 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.240337 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.240954 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:06.240957 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:06.241058 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 19:02:06.241226 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 19:02:06.241414 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 19:02:06.241995 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.227585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34904 (local address 127.16.188.253:44839)
0809 19:02:06.228125 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.228131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.228155 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:02:06.228199 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.228204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.228356 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.228463 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.229397 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.230427 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.232125 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.232705 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.232810 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.236130 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.236144 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.236160 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.236194 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.239377 (+ 3183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.239966 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.239974 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.239977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.240109 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.240428 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.240432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.240435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.240843 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.241026 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.241378 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.241629 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":273,"threads_started":1}
I20260809 19:02:06.244171 20134 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:02:06.245276 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.244786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48860)
0809 19:02:06.244942 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.245072 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 19:02:06.245566 20070 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
I20260809 19:02:06.247038 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.246664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48862)
0809 19:02:06.246827 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.246914 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 19:02:06.247251 20134 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab.
Entry for principal kudu/127.16.188.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab.
I20260809 19:02:06.268023 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.252:45893
--webserver_interface=127.16.188.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab
--principal=kudu/127.16.188.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:44553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:42627,127.16.188.253:44839,127.16.188.252:45893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:02:06.296512 20134 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 1
I20260809 19:02:06.297621 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.297187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48878)
0809 19:02:06.297367 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.297471 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 19:02:06.298591 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.298270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48884)
0809 19:02:06.298418 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.298487 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:02:06.298785 20134 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
I20260809 19:02:06.366976 20134 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 2
I20260809 19:02:06.368007 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.367567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48896)
0809 19:02:06.367761 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.367851 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 19:02:06.368984 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.368664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48904)
0809 19:02:06.368796 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.368867 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 19:02:06.369230 20134 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
I20260809 19:02:06.404810 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } attempt: 5
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302125, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 19:02:06.418581 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.405614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34920 (local address 127.16.188.253:44839)
0809 19:02:06.405769 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.405773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.405793 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:02:06.405979 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.405982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.406062 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.406153 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.407116 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.407790 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.409491 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.409944 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.410038 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.413677 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.413682 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.413685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.413718 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.416125 (+ 2407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.416877 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.416881 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.416883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.416998 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.417413 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.417417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.417418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.417682 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.417790 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.418195 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.418365 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:02:06.418736 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.405480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34920)
0809 19:02:06.405701 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.405725 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:06.405861 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:06.406211 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:06.406217 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:06.406729 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:06.406973 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.406986 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.407925 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.407931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.409340 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.409358 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.410095 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.410101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.410329 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.410974 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:06.410998 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:06.413494 (+ 2496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:06.416275 (+ 2781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.416281 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.416285 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.416775 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.417115 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.417120 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.417123 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.417315 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.417797 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:06.417802 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:06.417968 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 19:02:06.418111 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 19:02:06.418409 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 19:02:06.419773 20038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:02:06.420835 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.420474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48910)
0809 19:02:06.420636 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.420710 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 19:02:06.421748 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.421448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48920)
0809 19:02:06.421556 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.421651 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 19:02:06.421928 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
I20260809 19:02:06.460431 20134 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 3
I20260809 19:02:06.461665 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.461141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48930)
0809 19:02:06.461383 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.461494 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 19:02:06.462983 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.462402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48932)
0809 19:02:06.462691 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.462812 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260809 19:02:06.463248 20134 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
I20260809 19:02:06.473135 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 1
I20260809 19:02:06.474108 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.473721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48936)
0809 19:02:06.473882 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.473965 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 19:02:06.475035 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.474741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48940)
0809 19:02:06.474856 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.474922 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 19:02:06.475247 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
I20260809 19:02:06.543435 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 2
I20260809 19:02:06.544708 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.544145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48956)
0809 19:02:06.544418 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.544513 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260809 19:02:06.545883 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.545506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48962)
0809 19:02:06.545679 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.545763 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 19:02:06.546134 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
W20260809 19:02:06.594113 20144 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:02:06.594404 20144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:02:06.594501 20144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:02:06.594588 20144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:02:06.601476 20144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:02:06.601552 20144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:02:06.601620 20144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:02:06.601683 20144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:02:06.601773 20144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:02:06.606489 20134 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 4
I20260809 19:02:06.607689 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.607125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48964)
0809 19:02:06.607382 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.607492 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 19:02:06.608673 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.608307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48976)
0809 19:02:06.608461 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.608547 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 19:02:06.608881 20134 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
I20260809 19:02:06.611703 20144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:44553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:42627,127.16.188.253:44839,127.16.188.252:45893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab
--principal=kudu/127.16.188.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.252:45893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.188.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:02:06.612869 20144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:02:06.614363 20144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:02:06.625567 20153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:06.625608 20158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:06.625635 20155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:02:06.626502 20144 server_base.cc:1034] running on GCE node
I20260809 19:02:06.627223 20144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:02:06.628458 20144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:02:06.629668 20144 hybrid_clock.cc:648] HybridClock initialized: now 1786302126629606 us; error 42 us; skew 500 ppm
I20260809 19:02:06.629964 20144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:02:06.632844 20144 init.cc:377] Logged in from keytab as kudu/127.16.188.252@KRBTEST.COM (short username kudu)
I20260809 19:02:06.634368 20144 webserver.cc:460] Webserver started at http://127.16.188.252:45247/ using document root <none> and password file <none>
I20260809 19:02:06.635000 20144 fs_manager.cc:359] Metadata directory not provided
I20260809 19:02:06.635109 20144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:02:06.635399 20144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:02:06.638221 20144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/data/instance:
uuid: "2f57974da79049da8356d589548e5e43"
format_stamp: "Formatted at 2026-08-09 19:02:06 on dist-test-slave-266d"
server_key: "8861c1fb733b1590132a041801c458da"
server_key_iv: "1ca36970651387dc8a9b642d91d103e3"
server_key_version: "encryptionkey@0"
I20260809 19:02:06.638954 20144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/wal/instance:
uuid: "2f57974da79049da8356d589548e5e43"
format_stamp: "Formatted at 2026-08-09 19:02:06 on dist-test-slave-266d"
server_key: "8861c1fb733b1590132a041801c458da"
server_key_iv: "1ca36970651387dc8a9b642d91d103e3"
server_key_version: "encryptionkey@0"
I20260809 19:02:06.643630 20144 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 19:02:06.646763 20169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:02:06.647914 20144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:02:06.648083 20144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/wal
uuid: "2f57974da79049da8356d589548e5e43"
format_stamp: "Formatted at 2026-08-09 19:02:06 on dist-test-slave-266d"
server_key: "8861c1fb733b1590132a041801c458da"
server_key_iv: "1ca36970651387dc8a9b642d91d103e3"
server_key_version: "encryptionkey@0"
I20260809 19:02:06.648264 20144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:02:06.652344 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 3
I20260809 19:02:06.653390 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.652868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:48984)
0809 19:02:06.653050 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.653159 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 19:02:06.654431 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.654069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:49000)
0809 19:02:06.654268 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.654339 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260809 19:02:06.654623 20038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:45893: Network error: Client connection negotiation failed: client connection to 127.16.188.252:45893: connect: Connection refused (error 111)
I20260809 19:02:06.670184 20144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:02:06.673794 20144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:02:06.674031 20144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:02:06.690244 20144 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.252:45893
I20260809 19:02:06.690263 20242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.252:45893 every 8 connection(s)
I20260809 19:02:06.691435 20144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
I20260809 19:02:06.693045 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20144
I20260809 19:02:06.693251 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301765673554-17139-0/minicluster-data/master-2/wal/instance
I20260809 19:02:06.693833 17139 external_mini_cluster.cc:1428] Setting key a24bebd159113fba39002e322bee72f0
I20260809 19:02:06.695547 20243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:02:06.703509 20243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:02:06.716949 20248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.695643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49006 (local address 127.16.188.252:45893)
0809 19:02:06.696391 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.696402 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.696442 (+ 40us) server_negotiation.cc:407] Connection header received
0809 19:02:06.698019 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.698040 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.698393 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.698709 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.700463 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.702410 (+ 1947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.704173 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.705201 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.705386 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.710225 (+ 4839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.710231 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.710240 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.710285 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.713390 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.714042 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.714050 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.714058 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.714261 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.714573 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.714578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.714581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.715108 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.715357 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.715765 (+ 408us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.716042 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":333,"threads_started":1}
I20260809 19:02:06.721349 20249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.706064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:42627 (local address 127.0.0.1:35104)
0809 19:02:06.708392 (+ 2328us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.708424 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:06.708561 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:06.708936 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:06.708941 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:06.709552 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:06.709782 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.709790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.710817 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.710822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.712052 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.712065 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.713009 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.713013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.713171 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.713718 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:06.713739 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:06.716003 (+ 2264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:06.718879 (+ 2876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.718888 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.718892 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.719344 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.719890 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.719895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.719898 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.720048 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.720567 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:06.720572 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:06.720710 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 19:02:06.720845 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 19:02:06.721039 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2152,"thread_start_us":2057,"threads_started":1}
I20260809 19:02:06.721597 20044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.706134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35104 (local address 127.16.188.254:42627)
0809 19:02:06.706335 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.706342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.708517 (+ 2175us) server_negotiation.cc:407] Connection header received
0809 19:02:06.708685 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.708691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.708766 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.708861 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.709935 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.710683 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.712186 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.712840 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.712971 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.716216 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.716221 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.716224 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.716255 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.718762 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.719492 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.719498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.719502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.719729 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.720163 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.720167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.720169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.720450 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.720555 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.720993 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.721246 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:02:06.722708 20243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 19:02:06.733878 20250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.719376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35118 (local address 127.16.188.254:42627)
0809 19:02:06.719917 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.719922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.719944 (+ 22us) server_negotiation.cc:407] Connection header received
0809 19:02:06.719984 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.719989 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.720050 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.720157 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.722223 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.723205 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.724464 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.724844 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.724947 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.728963 (+ 4016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.728967 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.728970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.728999 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.731458 (+ 2459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.732034 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.732040 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.732042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.732154 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.732497 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.732502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.732506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.732779 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.733006 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.733351 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.733550 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":242,"threads_started":1}
I20260809 19:02:06.734750 20249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.723407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:44839 (local address 127.0.0.1:34924)
0809 19:02:06.723554 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.723568 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:06.723660 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:06.723944 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:06.723949 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:06.724274 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:06.724400 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.724407 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.725368 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.725373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.726290 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.726302 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.727009 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.727014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.727162 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.727623 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:06.727639 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:06.729681 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:06.732528 (+ 2847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.732533 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.732537 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.732872 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.733248 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.733253 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.733257 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.733396 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.733909 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:06.733913 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:06.734069 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 19:02:06.734194 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 19:02:06.734434 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 19:02:06.734865 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.723350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34924 (local address 127.16.188.253:44839)
0809 19:02:06.723508 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.723514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.723627 (+ 113us) server_negotiation.cc:407] Connection header received
0809 19:02:06.723768 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.723773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.723835 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.723914 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.724534 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.725234 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.726424 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.726871 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.726975 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.729885 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.729889 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.729892 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.729923 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.732405 (+ 2482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.732977 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.732981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.732983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.733144 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.733492 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.733498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.733501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.733787 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.733929 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.734309 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.734516 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:02:06.735703 20243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 19:02:06.747430 20249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.736378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:49012)
0809 19:02:06.736510 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.736526 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:06.736609 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:06.736966 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:06.736969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:06.737332 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:06.737448 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.737455 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.738313 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.738318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.739127 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.739137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.739792 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.739797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.739958 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.740451 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:06.740466 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:06.742515 (+ 2049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:06.745360 (+ 2845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.745365 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.745369 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.745685 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.746003 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.746008 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.746012 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.746126 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.746621 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:06.746625 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:06.746741 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 19:02:06.746859 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 19:02:06.747123 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 19:02:06.747728 20248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.736552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49012 (local address 127.16.188.252:45893)
0809 19:02:06.736728 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.736733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.736751 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:02:06.736796 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.736800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.736863 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.736957 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.737566 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.738198 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.739244 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.739648 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.739744 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.742679 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.742685 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.742690 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.742724 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.745238 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.745790 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.745794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.745798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.745908 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.746215 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.746220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.746224 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.746500 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.746638 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.746972 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.747266 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":62}
I20260809 19:02:06.748937 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.735608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34930 (local address 127.16.188.253:44839)
0809 19:02:06.735739 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.735742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.735756 (+ 14us) server_negotiation.cc:407] Connection header received
0809 19:02:06.735890 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.735895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.735955 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.736022 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.737322 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.737993 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.739107 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.739509 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.739628 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.743871 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.743875 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.743879 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.743906 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.746306 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.746963 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.746968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.746970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.747123 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.747704 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.747707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.747710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.748011 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.748255 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.748457 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.748710 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 19:02:06.753038 20243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: Bootstrap starting.
I20260809 19:02:06.753660 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:02:06.756814 20243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: Neither blocks nor log segments found. Creating new log.
I20260809 19:02:06.757899 20243 log.cc:824] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: Log is configured to *not* fsync() on all Append() calls
I20260809 19:02:06.757169 19998 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ab15e952001b42a098ef91101a5b11f3"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35118
I20260809 19:02:06.760563 20243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: No bootstrap required, opened a new log
I20260809 19:02:06.770700 20243 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } }
I20260809 19:02:06.771090 20243 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f57974da79049da8356d589548e5e43, State: Initialized, Role: FOLLOWER
I20260809 19:02:06.771570 20243 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } }
I20260809 19:02:06.772910 20254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:06.773386 20254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:06.774067 20243 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 19:02:06.783097 20273 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:02:06.783209 20273 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:02:06.780658 20144 master_runner.cc:186] Error getting master registration for 127.16.188.254:42627: OK, instance_id { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" instance_seqno: 1786302125695262 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:02:06.791155 20144 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:02:06.831853 20038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 4
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302125, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
I20260809 19:02:06.846899 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.832628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:49014)
0809 19:02:06.832900 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.832917 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:06.833051 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:06.833420 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:06.833425 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:06.833847 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:06.834041 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.834052 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.835116 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.835122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.836044 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.836056 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.836816 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.836822 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.837034 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.837734 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:06.837760 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:06.840300 (+ 2540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:06.844211 (+ 3911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.844217 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.844222 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.844725 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.845077 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.845082 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.845106 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.845286 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.845892 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:06.845897 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:06.846065 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 19:02:06.846208 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 19:02:06.846495 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260809 19:02:06.846907 20248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.832676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49014 (local address 127.16.188.252:45893)
0809 19:02:06.832902 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.832909 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.833008 (+ 99us) server_negotiation.cc:407] Connection header received
0809 19:02:06.833194 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.833200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.833274 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.833359 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.834192 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.834975 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.836185 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.836670 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.836781 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.840489 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.840496 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.840501 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.840541 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.844076 (+ 3535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.844835 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.844841 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.844844 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.844980 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.845392 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.845397 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.845400 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.845776 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.845942 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.846331 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.846545 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:02:06.853144 20038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3: Bootstrap starting.
I20260809 19:02:06.857348 20038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3: Neither blocks nor log segments found. Creating new log.
I20260809 19:02:06.858632 20038 log.cc:824] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3: Log is configured to *not* fsync() on all Append() calls
I20260809 19:02:06.861981 20038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3: No bootstrap required, opened a new log
I20260809 19:02:06.869349 20038 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } }
I20260809 19:02:06.869735 20038 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab15e952001b42a098ef91101a5b11f3, State: Initialized, Role: FOLLOWER
I20260809 19:02:06.870199 20038 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } }
I20260809 19:02:06.871129 20276 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:06.871567 20276 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:06.872368 20038 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:02:06.872529 19998 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 19:02:06.872730 19998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:02:06.875772 19998 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } }
I20260809 19:02:06.878357 19998 leader_election.cc:288] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [CANDIDATE]: Term 1 election: Requested vote from peers 61c1f1a89ba649808178ed835405bd92 (127.16.188.253:44839), 2f57974da79049da8356d589548e5e43 (127.16.188.252:45893)
I20260809 19:02:06.879180 20211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab15e952001b42a098ef91101a5b11f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2f57974da79049da8356d589548e5e43"
I20260809 19:02:06.879668 20211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:02:06.883415 20211 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab15e952001b42a098ef91101a5b11f3 in term 1.
I20260809 19:02:06.884275 19960 leader_election.cc:302] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f57974da79049da8356d589548e5e43, ab15e952001b42a098ef91101a5b11f3; no voters:
I20260809 19:02:06.884737 20276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:02:06.885067 20290 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 19:02:06.888957 20276 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [term 1 LEADER]: Becoming Leader. State: Replica: ab15e952001b42a098ef91101a5b11f3, State: Running, Role: LEADER
I20260809 19:02:06.889607 20276 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } }
I20260809 19:02:06.894011 20296 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab15e952001b42a098ef91101a5b11f3. Latest consensus state: current_term: 1 leader_uuid: "ab15e952001b42a098ef91101a5b11f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:06.894407 20296 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:06.905620 20305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:02:06.908071 20134 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } attempt: 5
I20260809 19:02:06.896870 19936 master_runner.cc:186] Error getting master registration for 127.16.188.253:44839: OK, instance_id { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" instance_seqno: 1786302126186813 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:02:06.919034 19936 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:02:06.920523 20305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 19:02:06.925863 20178 tablet.cc:2369] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 19:02:06 dist-test-slave-266d krb5kdc[19918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
W20260809 19:02:06.935591 19967 tablet.cc:2369] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:02:06.937932 20211 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [term 1 FOLLOWER]: Refusing update from remote peer ab15e952001b42a098ef91101a5b11f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:02:06.939348 20276 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:02:06.939910 20137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.908652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:45893 (local address 127.0.0.1:49038)
0809 19:02:06.908914 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:06.908933 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:06.909050 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:06.921981 (+ 12931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:06.921986 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:06.922495 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:06.922719 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.922733 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.924336 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.924342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.925762 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:06.925779 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.926736 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.926742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:06.926980 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.927719 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:06.927741 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:06.930563 (+ 2822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:06.935640 (+ 5077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.935645 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.935649 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.936199 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.936975 (+ 776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:06.936980 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:06.937004 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:06.937271 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:06.938437 (+ 1166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:06.938442 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:06.938687 (+ 245us) client_negotiation.cc:769] Sending connection context
0809 19:02:06.938884 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 19:02:06.939318 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144}
I20260809 19:02:06.941841 20308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.909409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49038 (local address 127.16.188.252:45893)
0809 19:02:06.921584 (+ 12175us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.921590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.921618 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:02:06.921684 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.921689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.921773 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.921944 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.923006 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.924206 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.925900 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.926597 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.926714 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.930762 (+ 4048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.930769 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.930774 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.930812 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.935459 (+ 4647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.936473 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.936479 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.936482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.936757 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.937514 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.937519 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.937526 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.938248 (+ 722us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.940451 (+ 2203us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.940688 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.941051 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12033,"thread_start_us":11845,"threads_started":1}
I20260809 19:02:06.947978 20134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92: Bootstrap starting.
I20260809 19:02:06.952646 20134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92: Neither blocks nor log segments found. Creating new log.
I20260809 19:02:06.956703 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.921685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34932 (local address 127.16.188.253:44839)
0809 19:02:06.921843 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.921848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.929689 (+ 7841us) server_negotiation.cc:407] Connection header received
0809 19:02:06.930252 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.930258 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.930353 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.930419 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.932484 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.933539 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.941059 (+ 7520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.941734 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.941831 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.948259 (+ 6428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.948275 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.948284 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.948322 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.952023 (+ 3701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.953502 (+ 1479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.953508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.953512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.953672 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.954502 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.954508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.954512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.954859 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.955076 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.955950 (+ 874us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.956345 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 19:02:06.958632 20134 log.cc:824] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92: Log is configured to *not* fsync() on all Append() calls
I20260809 19:02:06.968415 20134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92: No bootstrap required, opened a new log
I20260809 19:02:06.972716 20248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.892152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49022 (local address 127.16.188.252:45893)
0809 19:02:06.892321 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.892327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.929166 (+ 36839us) server_negotiation.cc:407] Connection header received
0809 19:02:06.932531 (+ 3365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.932536 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.932604 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.932669 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.936328 (+ 3659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.937529 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.942547 (+ 5018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.943205 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.943313 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.961733 (+ 18420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.961745 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.961750 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.961789 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.969059 (+ 7270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.969962 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.969967 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.969971 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.970121 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.970583 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.970589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.970592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.970954 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.971197 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.972099 (+ 902us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.972336 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:02:06.973539 20254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab15e952001b42a098ef91101a5b11f3. Latest consensus state: current_term: 1 leader_uuid: "ab15e952001b42a098ef91101a5b11f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:06.973889 20254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:06.977499 20250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:06.891922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35122 (local address 127.16.188.254:42627)
0809 19:02:06.892107 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:06.892113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:06.922411 (+ 30298us) server_negotiation.cc:407] Connection header received
0809 19:02:06.922671 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:06.922676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:06.922752 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:06.922835 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:06.931538 (+ 8703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.932612 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.951754 (+ 19142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:06.952408 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:06.952512 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:06.960997 (+ 8485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:06.961003 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:06.961008 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:06.961047 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:06.965685 (+ 4638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.975092 (+ 9407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.975097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.975101 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.975249 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:06.975752 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:06.975757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:06.975760 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:06.976106 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:06.976357 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:06.976902 (+ 545us) server_negotiation.cc:299] Negotiation successful
0809 19:02:06.977155 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 19:02:06.978907 20311 mvcc.cc:205] Tried to move back new op lower bound from 7316693511919214592 to 7316693511747502080. Current Snapshot: MvccSnapshot[applied={T|T < 7316693511919214592}]
I20260809 19:02:06.981505 20276 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab15e952001b42a098ef91101a5b11f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:06.981812 20276 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:06.983366 20305 catalog_manager.cc:1347] Generated new cluster ID: 35afae41f2874bff95296228f28c4963
I20260809 19:02:06.983455 20305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:02:06.985632 20134 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } }
I20260809 19:02:06.985961 20134 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c1f1a89ba649808178ed835405bd92, State: Initialized, Role: FOLLOWER
I20260809 19:02:06.986374 20134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } }
I20260809 19:02:06.987170 20254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab15e952001b42a098ef91101a5b11f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:06.987413 20254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:06.990662 20134 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:02:06.991112 20102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab15e952001b42a098ef91101a5b11f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "61c1f1a89ba649808178ed835405bd92"
I20260809 19:02:06.991936 20318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:06.992297 20318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:06.992259 20099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:02:06.996071 20099 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [term 1 FOLLOWER]: Refusing update from remote peer ab15e952001b42a098ef91101a5b11f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:02:07.002446 20102 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab15e952001b42a098ef91101a5b11f3 in term 1.
I20260809 19:02:07.007390 20296 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:02:07.021340 20305 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:02:07.024009 20305 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:02:07.038236 20305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3: Generated new TSK 0
I20260809 19:02:07.039248 20305 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:02:07.043419 20318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab15e952001b42a098ef91101a5b11f3. Latest consensus state: current_term: 1 leader_uuid: "ab15e952001b42a098ef91101a5b11f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:07.043735 20318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:07.043846 20276 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab15e952001b42a098ef91101a5b11f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:07.044113 20276 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab15e952001b42a098ef91101a5b11f3 [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:07.047431 20330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab15e952001b42a098ef91101a5b11f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab15e952001b42a098ef91101a5b11f3" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 42627 } } peers { permanent_uuid: "61c1f1a89ba649808178ed835405bd92" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 44839 } } peers { permanent_uuid: "2f57974da79049da8356d589548e5e43" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 45893 } } }
I20260809 19:02:07.047927 20330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:07.097105 20339 catalog_manager.cc:1259] Loaded cluster ID: 35afae41f2874bff95296228f28c4963
I20260809 19:02:07.097216 20339 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92: loading cluster ID for follower catalog manager: success
I20260809 19:02:07.100833 20339 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92: acquiring CA information for follower catalog manager: success
I20260809 19:02:07.103185 20339 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 61c1f1a89ba649808178ed835405bd92: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 19:02:07.205000 20250 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.179323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35132 (local address 127.16.188.254:42627)
0809 19:02:07.179516 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.179522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.201348 (+ 21826us) server_negotiation.cc:407] Connection header received
0809 19:02:07.203416 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.203422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.203503 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.203571 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.204728 (+ 1157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35132: BlockingRecv error: recv got EOF from 127.0.0.1:35132 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 19:02:07.207036 20139 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.199039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34934 (local address 127.16.188.253:44839)
0809 19:02:07.199268 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.199274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.205574 (+ 6300us) server_negotiation.cc:407] Connection header received
0809 19:02:07.205812 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.205818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.205911 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.205979 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.206823 (+ 844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34934: BlockingRecv error: recv got EOF from 127.0.0.1:34934 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 19:02:07.209185 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.185790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49048 (local address 127.16.188.252:45893)
0809 19:02:07.185969 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.185975 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.202864 (+ 16889us) server_negotiation.cc:407] Connection header received
0809 19:02:07.203066 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.203072 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.203156 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.203253 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.208920 (+ 5667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49048: BlockingRecv error: recv got EOF from 127.0.0.1:49048 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 19:02:07.248603 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.233800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34948 (local address 127.16.188.253:44839)
0809 19:02:07.233983 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.233989 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.240762 (+ 6773us) server_negotiation.cc:407] Connection header received
0809 19:02:07.241350 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.241356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.241550 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.241687 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.242387 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.243505 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.245598 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.246288 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.246383 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.247102 (+ 719us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.247808 (+ 706us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.247931 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.248178 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.248268 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 19:02:07.291471 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.279083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.16.188.252:45893)
0809 19:02:07.279287 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.279293 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.289625 (+ 10332us) server_negotiation.cc:407] Connection header received
0809 19:02:07.289907 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.289914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.290040 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.290117 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.291225 (+ 1108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49050: BlockingRecv error: recv got EOF from 127.0.0.1:49050 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 19:02:07.348407 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.329052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34954 (local address 127.16.188.253:44839)
0809 19:02:07.329326 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.329332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.341698 (+ 12366us) server_negotiation.cc:407] Connection header received
0809 19:02:07.341924 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.341931 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.342031 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.342119 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.342813 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.343937 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.345982 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.346757 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.346909 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.347450 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.347619 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.347693 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.347947 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.348046 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
W20260809 19:02:07.359189 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.356112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.16.188.252:45893)
0809 19:02:07.356331 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.356338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.357686 (+ 1348us) server_negotiation.cc:407] Connection header received
0809 19:02:07.357879 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.357884 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.357983 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.358091 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.358953 (+ 862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49062: BlockingRecv error: recv got EOF from 127.0.0.1:49062 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 19:02:07.371891 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.364964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.16.188.253:44839)
0809 19:02:07.365177 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.365182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.365676 (+ 494us) server_negotiation.cc:407] Connection header received
0809 19:02:07.365864 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.365871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.365966 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.366078 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.366518 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.367753 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.369703 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.370382 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.370530 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.370987 (+ 457us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.371160 (+ 173us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.371260 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.371430 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.371550 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 19:02:07.385151 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.383331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49072 (local address 127.16.188.252:45893)
0809 19:02:07.383510 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.383517 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.383541 (+ 24us) server_negotiation.cc:407] Connection header received
0809 19:02:07.383845 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.383852 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.383955 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.384078 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.384878 (+ 800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49072: BlockingRecv error: recv got EOF from 127.0.0.1:49072 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 19:02:07.401702 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.394924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34982 (local address 127.16.188.253:44839)
0809 19:02:07.395148 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.395154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.395640 (+ 486us) server_negotiation.cc:407] Connection header received
0809 19:02:07.395823 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.395829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.395910 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.396002 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.396476 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.397656 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.399562 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.400274 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.400406 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.400882 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.401035 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.401172 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.401331 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.401414 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
W20260809 19:02:07.419193 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.413911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49080 (local address 127.16.188.252:45893)
0809 19:02:07.414176 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.414183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.417670 (+ 3487us) server_negotiation.cc:407] Connection header received
0809 19:02:07.417877 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.417884 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.417982 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.418089 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.418942 (+ 853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49080: BlockingRecv error: recv got EOF from 127.0.0.1:49080 (error 108)
Metrics: {"server-negotiator.queue_time_us":143}
I20260809 19:02:07.437443 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.430114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34994 (local address 127.16.188.253:44839)
0809 19:02:07.430291 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.430297 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.430793 (+ 496us) server_negotiation.cc:407] Connection header received
0809 19:02:07.431048 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.431055 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.431140 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.431196 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.431805 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.432987 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.434906 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.435602 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.435749 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.436249 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.436421 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.436529 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.436998 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.437112 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 19:02:07.447017 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.444591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49086 (local address 127.16.188.252:45893)
0809 19:02:07.444789 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.444795 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.445346 (+ 551us) server_negotiation.cc:407] Connection header received
0809 19:02:07.445529 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.445535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.445664 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.445769 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.446783 (+ 1014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49086: BlockingRecv error: recv got EOF from 127.0.0.1:49086 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 19:02:07.473591 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.466712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35006 (local address 127.16.188.253:44839)
0809 19:02:07.466899 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.466906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.467393 (+ 487us) server_negotiation.cc:407] Connection header received
0809 19:02:07.467592 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.467597 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.467683 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.467782 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.468276 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.469503 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.471336 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.472035 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.472162 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.472725 (+ 563us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.472862 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.472944 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.473153 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.473246 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 19:02:07.482949 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.481084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49094 (local address 127.16.188.252:45893)
0809 19:02:07.481303 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.481309 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.481501 (+ 192us) server_negotiation.cc:407] Connection header received
0809 19:02:07.481738 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.481744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.481834 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.481929 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.482740 (+ 811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49094: BlockingRecv error: recv got EOF from 127.0.0.1:49094 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 19:02:07.524827 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.518988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35010 (local address 127.16.188.253:44839)
0809 19:02:07.519221 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.519227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.519464 (+ 237us) server_negotiation.cc:407] Connection header received
0809 19:02:07.519708 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.519712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.519782 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.519859 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.520351 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.521116 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.523044 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.523565 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.523660 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.524138 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.524241 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.524309 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.524448 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.524511 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260809 19:02:07.533170 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.531038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49102 (local address 127.16.188.252:45893)
0809 19:02:07.531228 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.531235 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.531874 (+ 639us) server_negotiation.cc:407] Connection header received
0809 19:02:07.532005 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.532011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.532101 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.532203 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.532925 (+ 722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49102: BlockingRecv error: recv got EOF from 127.0.0.1:49102 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 19:02:07.606015 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.600912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35018 (local address 127.16.188.253:44839)
0809 19:02:07.601149 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.601156 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.601462 (+ 306us) server_negotiation.cc:407] Connection header received
0809 19:02:07.601695 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.601699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.601770 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.601848 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.602305 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.603172 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.604619 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.604996 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.605113 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.605456 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.605567 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.605655 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.605742 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.605810 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 19:02:07.612744 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.611230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49114 (local address 127.16.188.252:45893)
0809 19:02:07.611384 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.611388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.611666 (+ 278us) server_negotiation.cc:407] Connection header received
0809 19:02:07.611804 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.611808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.611881 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.611960 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.612578 (+ 618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49114: BlockingRecv error: recv got EOF from 127.0.0.1:49114 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 19:02:07.748569 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:07.744010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35030 (local address 127.16.188.253:44839)
0809 19:02:07.744247 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.744253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.744512 (+ 259us) server_negotiation.cc:407] Connection header received
0809 19:02:07.744678 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.744682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.744756 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.744835 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:07.745217 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.745889 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.747146 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:07.747558 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:07.747658 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:07.747974 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:07.748076 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:07.748149 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:07.748241 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 19:02:07.748305 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260809 19:02:07.755810 20248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:07.754055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49130 (local address 127.16.188.252:45893)
0809 19:02:07.754263 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:07.754269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:07.754493 (+ 224us) server_negotiation.cc:407] Connection header received
0809 19:02:07.754686 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:07.754691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:07.754764 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:07.754846 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:07.755588 (+ 742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49130: BlockingRecv error: recv got EOF from 127.0.0.1:49130 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 19:02:07.785175 20273 catalog_manager.cc:1259] Loaded cluster ID: 35afae41f2874bff95296228f28c4963
I20260809 19:02:07.785262 20273 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: loading cluster ID for follower catalog manager: success
I20260809 19:02:07.787703 20273 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: acquiring CA information for follower catalog manager: success
I20260809 19:02:07.789487 20273 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2f57974da79049da8356d589548e5e43: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:02:08.023186 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:08.018687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35036 (local address 127.16.188.253:44839)
0809 19:02:08.018846 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:08.018850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:08.019145 (+ 295us) server_negotiation.cc:407] Connection header received
0809 19:02:08.019314 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:08.019318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:08.019402 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:08.019479 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:08.019846 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.020532 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.021795 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.022179 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.022272 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:08.022569 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:08.022693 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:08.022782 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:08.022890 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 19:02:08.022970 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 19:02:08.034196 20248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:08.028535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49136 (local address 127.16.188.252:45893)
0809 19:02:08.028751 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:08.028757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:08.029134 (+ 377us) server_negotiation.cc:407] Connection header received
0809 19:02:08.029328 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:08.029332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:08.029496 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:08.029588 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:08.029980 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.030662 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.032063 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.032475 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.032567 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:08.033051 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:08.033669 (+ 618us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:08.033781 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:08.033866 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 19:02:08.033934 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 19:02:08.046864 20139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:08.039775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35044 (local address 127.16.188.253:44839)
0809 19:02:08.040101 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:08.040107 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:08.041344 (+ 1237us) server_negotiation.cc:407] Connection header received
0809 19:02:08.041587 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:08.041593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:08.041672 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:08.041753 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:08.042322 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.043106 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.044833 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.045462 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.045571 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:08.046097 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:08.046232 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:08.046320 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:08.046471 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 19:02:08.046555 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203}
I20260809 19:02:08.047516 20248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:08.039927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49144 (local address 127.16.188.252:45893)
0809 19:02:08.040228 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:08.040234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:08.041669 (+ 1435us) server_negotiation.cc:407] Connection header received
0809 19:02:08.041850 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:08.041854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:08.041931 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:08.041976 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:08.042696 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.043683 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.045594 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.046174 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.046264 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:08.046832 (+ 568us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:08.046925 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:08.046983 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:08.047188 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 19:02:08.047274 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198}
I20260809 19:02:08.047823 20493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:08.039936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35142 (local address 127.16.188.254:42627)
0809 19:02:08.040544 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:08.040550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:08.041313 (+ 763us) server_negotiation.cc:407] Connection header received
0809 19:02:08.041432 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:08.041437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:08.041638 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:08.041808 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:08.042565 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.043626 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.045545 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:08.045961 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:08.046071 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:08.046710 (+ 639us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:08.047154 (+ 444us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:08.047274 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:08.047451 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 19:02:08.047534 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":402,"threads_started":1}
I20260809 19:02:08.052078 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 19936
I20260809 19:02:08.053159 20030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:02:08.160631 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 19936
W20260809 19:02:08.190892 20173 connection.cc:535] server connection from 127.0.0.1:49014 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 19:02:08.191358 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20049
I20260809 19:02:08.192454 20127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:02:08.300673 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20049
I20260809 19:02:08.327148 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20144
I20260809 19:02:08.328226 20237 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:02:08.432853 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20144
2026-08-09T19:02:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4705 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 19:02:08 dist-test-slave-266d krb5kdc[20504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 19:02:08 dist-test-slave-266d krb5kdc[20504](info): set up 2 sockets
Aug 09 19:02:08 dist-test-slave-266d krb5kdc[20504](info): commencing operation
krb5kdc: starting...
W20260809 19:02:09.696524 17139 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/test-user.keytab.
Aug 09 19:02:09 dist-test-slave-266d krb5kdc[20504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T19:02:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T19:02:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.188.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
Entry for principal kudu/127.16.188.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab.
I20260809 19:02:09.984094 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:32879
--webserver_interface=127.16.188.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:32879,127.16.188.253:42865,127.16.188.252:41585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 19:02:10.306502 20531 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:02:10.306799 20531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:02:10.306902 20531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:02:10.307003 20531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:02:10.313992 20531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:02:10.314067 20531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:02:10.314150 20531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:02:10.314213 20531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:02:10.314306 20531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:02:10.323544 20531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:32879,127.16.188.253:42865,127.16.188.252:41585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.254.keytab
--principal=kudu/127.16.188.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.254:32879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.188.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:02:10.324736 20531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:02:10.325990 20531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:02:10.337154 20537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:10.337155 20544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:10.337069 20539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:02:10.338265 20531 server_base.cc:1034] running on GCE node
I20260809 19:02:10.338997 20531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:02:10.340346 20531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:02:10.341560 20531 hybrid_clock.cc:648] HybridClock initialized: now 1786302130341495 us; error 41 us; skew 500 ppm
I20260809 19:02:10.341864 20531 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:02:10 dist-test-slave-266d krb5kdc[20504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:02:10.347626 20531 init.cc:377] Logged in from keytab as kudu/127.16.188.254@KRBTEST.COM (short username kudu)
I20260809 19:02:10.349033 20531 webserver.cc:460] Webserver started at http://127.16.188.254:37753/ using document root <none> and password file <none>
I20260809 19:02:10.349717 20531 fs_manager.cc:359] Metadata directory not provided
I20260809 19:02:10.349814 20531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:02:10.350086 20531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:02:10.352973 20531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/data/instance:
uuid: "9eb515dc84db4805886148f6c8d293da"
format_stamp: "Formatted at 2026-08-09 19:02:10 on dist-test-slave-266d"
server_key: "8c304b24974da78392c789c2399b78ed"
server_key_iv: "90c31ec88bf7946848259474cbe77477"
server_key_version: "encryptionkey@0"
I20260809 19:02:10.353775 20531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/wal/instance:
uuid: "9eb515dc84db4805886148f6c8d293da"
format_stamp: "Formatted at 2026-08-09 19:02:10 on dist-test-slave-266d"
server_key: "8c304b24974da78392c789c2399b78ed"
server_key_iv: "90c31ec88bf7946848259474cbe77477"
server_key_version: "encryptionkey@0"
I20260809 19:02:10.358745 20531 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 19:02:10.362218 20555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:02:10.363493 20531 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:02:10.363648 20531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/wal
uuid: "9eb515dc84db4805886148f6c8d293da"
format_stamp: "Formatted at 2026-08-09 19:02:10 on dist-test-slave-266d"
server_key: "8c304b24974da78392c789c2399b78ed"
server_key_iv: "90c31ec88bf7946848259474cbe77477"
server_key_version: "encryptionkey@0"
I20260809 19:02:10.363850 20531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:02:10.392515 20531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:02:10.396613 20531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:02:10.396848 20531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:02:10.414093 20531 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.254:32879
I20260809 19:02:10.414139 20628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.254:32879 every 8 connection(s)
I20260809 19:02:10.415330 20531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/data/info.pb
I20260809 19:02:10.416960 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20531
I20260809 19:02:10.417198 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-0/wal/instance
I20260809 19:02:10.417851 17139 external_mini_cluster.cc:1428] Setting key a61a610ebd678da9b8eda3e813b152c7
I20260809 19:02:10.419875 20629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:02:10.428777 20629 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:10 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:02:10.452417 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.432461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:32879 (local address 127.0.0.1:45630)
0809 19:02:10.433278 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.433323 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:10.435219 (+ 1896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:10.436123 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:10.436128 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:10.436713 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:10.437054 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:10.437083 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.439218 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.439222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:10.440382 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:10.440396 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.441558 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.441566 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:10.441710 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:10.442345 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:10.442369 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:10.444789 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:10.448516 (+ 3727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:10.448527 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:10.448536 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:10.448940 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:10.449437 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:10.449440 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:10.449443 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:10.449642 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:10.450626 (+ 984us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:10.450632 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:10.450828 (+ 196us) client_negotiation.cc:769] Sending connection context
0809 19:02:10.451039 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 19:02:10.451407 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":319,"threads_started":1}
I20260809 19:02:10.452483 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.432463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45630 (local address 127.16.188.254:32879)
0809 19:02:10.434022 (+ 1559us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:10.434033 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:10.434086 (+ 53us) server_negotiation.cc:407] Connection header received
0809 19:02:10.435562 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:10.435569 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:10.435846 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:10.436032 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:10.437328 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.439023 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.440529 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.441330 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.441545 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:10.445033 (+ 3488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:10.445043 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:10.445057 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:10.445120 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:10.448390 (+ 3270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:10.449077 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:10.449106 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:10.449110 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:10.449303 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:10.449749 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:10.449755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:10.449758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:10.450430 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:10.450637 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:10.451234 (+ 597us) server_negotiation.cc:299] Negotiation successful
0809 19:02:10.451584 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":1344,"thread_start_us":1151,"threads_started":1}
WARNING: no policy specified for kudu/127.16.188.253@KRBTEST.COM; defaulting to no policy
I20260809 19:02:10.455241 20629 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:02:10.456146 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.455808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:60952)
0809 19:02:10.455949 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.456049 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.253@KRBTEST.COM" created.
W20260809 19:02:10.456403 20557 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
I20260809 19:02:10.457850 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.457530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:60966)
0809 19:02:10.457666 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.457736 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:02:10.458048 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:42865: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab.
Entry for principal kudu/127.16.188.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab.
I20260809 19:02:10.489696 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.253:42865
--webserver_interface=127.16.188.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab
--principal=kudu/127.16.188.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:32879,127.16.188.253:42865,127.16.188.252:41585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:02:10.507373 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } attempt: 1
I20260809 19:02:10.508641 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.508094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:60976)
0809 19:02:10.508346 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.508475 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 19:02:10.509656 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.509268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:60992)
0809 19:02:10.509424 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.509506 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 19:02:10.509835 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:42865: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
I20260809 19:02:10.578089 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } attempt: 2
I20260809 19:02:10.579330 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.578773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:60998)
0809 19:02:10.579034 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.579149 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 19:02:10.580358 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.579959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:32772)
0809 19:02:10.580104 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.580203 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:02:10.580540 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:42865: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
I20260809 19:02:10.671805 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } attempt: 3
I20260809 19:02:10.673044 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.672511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:32788)
0809 19:02:10.672740 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.672870 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 19:02:10.674122 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.673716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:32796)
0809 19:02:10.673867 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.673953 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 19:02:10.674324 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:42865: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
W20260809 19:02:10.814344 20638 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 19:02:10.814625 20638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:02:10.814692 20638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:02:10.814771 20638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 19:02:10.817571 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } attempt: 4
I20260809 19:02:10.818843 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.818226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:32804)
0809 19:02:10.818551 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.818662 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
I20260809 19:02:10.819857 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.819458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:32814)
0809 19:02:10.819599 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.819695 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 19:02:10.820056 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.253:42865: Network error: Client connection negotiation failed: client connection to 127.16.188.253:42865: connect: Connection refused (error 111)
W20260809 19:02:10.822432 20638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:02:10.822505 20638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:02:10.822567 20638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:02:10.822615 20638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:02:10.822674 20638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:02:10.831928 20638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:32879,127.16.188.253:42865,127.16.188.252:41585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.253.keytab
--principal=kudu/127.16.188.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.253:42865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.188.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:02:10.833164 20638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:02:10.834354 20638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:02:10.845353 20646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:10.845323 20647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:10.845613 20649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:02:10.846370 20638 server_base.cc:1034] running on GCE node
I20260809 19:02:10.847066 20638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:02:10.848340 20638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:02:10.849553 20638 hybrid_clock.cc:648] HybridClock initialized: now 1786302130849483 us; error 39 us; skew 500 ppm
I20260809 19:02:10.849846 20638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:02:10 dist-test-slave-266d krb5kdc[20504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:02:10.852766 20638 init.cc:377] Logged in from keytab as kudu/127.16.188.253@KRBTEST.COM (short username kudu)
I20260809 19:02:10.854172 20638 webserver.cc:460] Webserver started at http://127.16.188.253:38101/ using document root <none> and password file <none>
I20260809 19:02:10.854825 20638 fs_manager.cc:359] Metadata directory not provided
I20260809 19:02:10.854909 20638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:02:10.855206 20638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:02:10.858058 20638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/data/instance:
uuid: "d177979777c14524b819bc5e8aa52f3b"
format_stamp: "Formatted at 2026-08-09 19:02:10 on dist-test-slave-266d"
server_key: "e0b3fb6aff03528da104ff6e93836fc3"
server_key_iv: "895770bd69abf36da36ff2a4df0c06bc"
server_key_version: "encryptionkey@0"
I20260809 19:02:10.858814 20638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/wal/instance:
uuid: "d177979777c14524b819bc5e8aa52f3b"
format_stamp: "Formatted at 2026-08-09 19:02:10 on dist-test-slave-266d"
server_key: "e0b3fb6aff03528da104ff6e93836fc3"
server_key_iv: "895770bd69abf36da36ff2a4df0c06bc"
server_key_version: "encryptionkey@0"
I20260809 19:02:10.863588 20638 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 19:02:10.866734 20657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:02:10.867926 20638 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 19:02:10.868094 20638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/wal
uuid: "d177979777c14524b819bc5e8aa52f3b"
format_stamp: "Formatted at 2026-08-09 19:02:10 on dist-test-slave-266d"
server_key: "e0b3fb6aff03528da104ff6e93836fc3"
server_key_iv: "895770bd69abf36da36ff2a4df0c06bc"
server_key_version: "encryptionkey@0"
I20260809 19:02:10.868299 20638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:02:10.884580 20638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:02:10.888271 20638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:02:10.888501 20638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:02:10.905056 20638 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.253:42865
I20260809 19:02:10.905074 20727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.253:42865 every 8 connection(s)
I20260809 19:02:10.906388 20638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/data/info.pb
I20260809 19:02:10.909957 20728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:02:10.916049 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20638
I20260809 19:02:10.916255 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-1/wal/instance
I20260809 19:02:10.916863 17139 external_mini_cluster.cc:1428] Setting key ca99d140d52978a78b2ed544b9a945e9
I20260809 19:02:10.916389 20728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:10 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:02:10.935761 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.919463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45632 (local address 127.16.188.254:32879)
0809 19:02:10.919675 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:10.919682 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:10.920672 (+ 990us) server_negotiation.cc:407] Connection header received
0809 19:02:10.922475 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:10.922480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:10.922559 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:10.922677 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:10.923989 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.924888 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.926308 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.926851 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.926970 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:10.930082 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:10.930088 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:10.930093 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:10.930131 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:10.932921 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:10.933732 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:10.933736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:10.933738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:10.933858 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:10.934299 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:10.934302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:10.934304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:10.934556 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:10.934677 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:10.935366 (+ 689us) server_negotiation.cc:299] Negotiation successful
0809 19:02:10.935523 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 19:02:10.936954 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.919781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:32879 (local address 127.0.0.1:45632)
0809 19:02:10.920499 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.920542 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:10.922216 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:10.922833 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:10.922841 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:10.923331 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:10.923831 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:10.923848 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.925010 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.925013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:10.926164 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:10.926176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.927020 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.927025 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:10.927213 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:10.927822 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:10.927842 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:10.929875 (+ 2033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:10.933051 (+ 3176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:10.933060 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:10.933074 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:10.933627 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:10.933960 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:10.933965 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:10.933968 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:10.934207 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:10.934679 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:10.934686 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:10.935040 (+ 354us) client_negotiation.cc:769] Sending connection context
0809 19:02:10.935309 (+ 269us) client_negotiation.cc:240] Negotiation successful
0809 19:02:10.935783 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":282,"threads_started":1}
I20260809 19:02:10.938617 20728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:10 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.188.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.188.252@KRBTEST.COM" created.
I20260809 19:02:10.953166 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.939351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:32830)
0809 19:02:10.939522 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.939541 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:10.939642 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:10.940605 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:10.940609 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:10.940952 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:10.941084 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:10.941124 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.942896 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.942899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:10.943721 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:10.943731 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.944735 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.944738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:10.944856 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:10.945394 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:10.945410 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:10.947507 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:10.950973 (+ 3466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:10.950977 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:10.950980 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:10.951386 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:10.951704 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:10.951707 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:10.951709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:10.951827 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:10.952396 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:10.952399 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:10.952510 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 19:02:10.952636 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 19:02:10.952840 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 19:02:10.953606 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.939474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32830 (local address 127.16.188.253:42865)
0809 19:02:10.940166 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:10.940173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:10.940201 (+ 28us) server_negotiation.cc:407] Connection header received
0809 19:02:10.940253 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:10.940259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:10.940461 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:10.940597 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:10.941283 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.942764 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.943849 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:10.944611 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:10.944733 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:10.947717 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:10.947731 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:10.947747 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:10.947785 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:10.950868 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:10.951501 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:10.951507 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:10.951509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:10.951616 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:10.951907 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:10.951910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:10.951912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:10.952295 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:10.952444 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:10.952792 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 19:02:10.953036 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":395,"threads_started":1}
I20260809 19:02:10.955777 20728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:02:10.956735 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.956368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35164)
0809 19:02:10.956503 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.956607 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 19:02:10.956969 20660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
I20260809 19:02:10.958379 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:10.958073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35180)
0809 19:02:10.958218 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:10.958290 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 19:02:10.958575 20728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.188.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab.
Entry for principal kudu/127.16.188.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab.
I20260809 19:02:10.986006 17139 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr97ygv/build/asan/bin/kudu
/tmp/dist-test-taskr97ygv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.252:41585
--webserver_interface=127.16.188.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab
--principal=kudu/127.16.188.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.188.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.188.254:32879,127.16.188.253:42865,127.16.188.252:41585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 19:02:11.007843 20728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 1
I20260809 19:02:11.008970 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.008537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35184)
0809 19:02:11.008716 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.008823 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 19:02:11.009958 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.009632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35196)
0809 19:02:11.009781 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.009854 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 19:02:11.010159 20728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
I20260809 19:02:11.078349 20728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 2
I20260809 19:02:11.079443 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.079020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35212)
0809 19:02:11.079197 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.079288 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 19:02:11.080395 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.080072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35220)
0809 19:02:11.080213 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.080281 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 19:02:11.080591 20728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
I20260809 19:02:11.119269 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } attempt: 5
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 19:02:11.131870 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.120031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32832 (local address 127.16.188.253:42865)
0809 19:02:11.120213 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.120218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.120293 (+ 75us) server_negotiation.cc:407] Connection header received
0809 19:02:11.120494 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.120498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.120579 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.120665 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.121506 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.122189 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.123319 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.123771 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.123882 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.126913 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.126917 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.126920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.126953 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.129450 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.130028 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.130033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.130035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.130152 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.130506 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.130511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.130514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.130794 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.130924 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.131303 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.131528 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 19:02:11.131877 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.119976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:32832)
0809 19:02:11.120193 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.120213 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:11.120371 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:11.120724 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:11.120729 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:11.121158 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:11.121353 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.121363 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.122326 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.122330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.123171 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.123182 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.123909 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.123915 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.124125 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.124745 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:11.124762 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:11.126731 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:11.129576 (+ 2845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.129582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.129586 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.129921 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.130253 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.130258 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.130270 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.130405 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.130907 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:11.130912 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:11.131060 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 19:02:11.131184 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 19:02:11.131557 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 19:02:11.132858 20629 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } has no permanent_uuid. Determining permanent_uuid...
I20260809 19:02:11.133863 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.133522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35232)
0809 19:02:11.133675 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.133745 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 19:02:11.134760 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.134462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35236)
0809 19:02:11.134593 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.134662 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:02:11.134944 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
I20260809 19:02:11.171783 20728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 3
I20260809 19:02:11.172899 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.172433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35244)
0809 19:02:11.172636 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.172732 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 19:02:11.173909 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.173488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35258)
0809 19:02:11.173710 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.173793 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260809 19:02:11.174118 20728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
I20260809 19:02:11.186126 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 1
I20260809 19:02:11.187054 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.186648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35268)
0809 19:02:11.186820 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.186902 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 19:02:11.187994 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.187683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35278)
0809 19:02:11.187823 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.187890 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:02:11.188189 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
I20260809 19:02:11.256388 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 2
I20260809 19:02:11.257517 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.257006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35294)
0809 19:02:11.257259 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.257358 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 19:02:11.258522 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.258187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35302)
0809 19:02:11.258332 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.258411 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 19:02:11.258718 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
I20260809 19:02:11.317299 20728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 4
I20260809 19:02:11.318375 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.317909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35314)
0809 19:02:11.318130 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.318215 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 19:02:11.318994 20735 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
I20260809 19:02:11.319406 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.319109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35320)
0809 19:02:11.319226 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.319293 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 19:02:11.319427 20735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 19:02:11.319537 20735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 19:02:11.319645 20728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
W20260809 19:02:11.319695 20735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 19:02:11.326987 20735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 19:02:11.327075 20735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 19:02:11.327173 20735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 19:02:11.327245 20735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 19:02:11.327339 20735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 19:02:11.337303 20735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.188.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.188.254:32879,127.16.188.253:42865,127.16.188.252:41585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/krb5kdc/kudu_127.16.188.252.keytab
--principal=kudu/127.16.188.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.188.252:41585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.188.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:02:09 UTC on ccycloud.quasar-jouoqf.root.comops.site
build id 4576689
ASAN enabled
I20260809 19:02:11.338528 20735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 19:02:11.339825 20735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 19:02:11.350874 20749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:11.350922 20744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 19:02:11.351361 20742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 19:02:11.351490 20735 server_base.cc:1034] running on GCE node
I20260809 19:02:11.352226 20735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 19:02:11.353524 20735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 19:02:11.354750 20735 hybrid_clock.cc:648] HybridClock initialized: now 1786302131354683 us; error 35 us; skew 500 ppm
I20260809 19:02:11.355046 20735 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302131, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 19:02:11.358104 20735 init.cc:377] Logged in from keytab as kudu/127.16.188.252@KRBTEST.COM (short username kudu)
I20260809 19:02:11.359373 20735 webserver.cc:460] Webserver started at http://127.16.188.252:44157/ using document root <none> and password file <none>
I20260809 19:02:11.359999 20735 fs_manager.cc:359] Metadata directory not provided
I20260809 19:02:11.360096 20735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 19:02:11.360401 20735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 19:02:11.363205 20735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/data/instance:
uuid: "10e7e9e3015948f3a19ba4db57103237"
format_stamp: "Formatted at 2026-08-09 19:02:11 on dist-test-slave-266d"
server_key: "8e50960d54e659631729fc48cea70718"
server_key_iv: "6bd881512a672eef1ac627e637758ad4"
server_key_version: "encryptionkey@0"
I20260809 19:02:11.363955 20735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/wal/instance:
uuid: "10e7e9e3015948f3a19ba4db57103237"
format_stamp: "Formatted at 2026-08-09 19:02:11 on dist-test-slave-266d"
server_key: "8e50960d54e659631729fc48cea70718"
server_key_iv: "6bd881512a672eef1ac627e637758ad4"
server_key_version: "encryptionkey@0"
I20260809 19:02:11.364923 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 3
I20260809 19:02:11.366055 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.365540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35330)
0809 19:02:11.365760 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.365864 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 19:02:11.367177 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.366743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35336)
0809 19:02:11.366957 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.367052 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260809 19:02:11.367413 20629 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.188.252:41585: Network error: Client connection negotiation failed: client connection to 127.16.188.252:41585: connect: Connection refused (error 111)
I20260809 19:02:11.369432 20735 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 19:02:11.372665 20759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 19:02:11.373907 20735 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 19:02:11.374058 20735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/data,/tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/wal
uuid: "10e7e9e3015948f3a19ba4db57103237"
format_stamp: "Formatted at 2026-08-09 19:02:11 on dist-test-slave-266d"
server_key: "8e50960d54e659631729fc48cea70718"
server_key_iv: "6bd881512a672eef1ac627e637758ad4"
server_key_version: "encryptionkey@0"
I20260809 19:02:11.374244 20735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 19:02:11.394312 20735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 19:02:11.397914 20735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 19:02:11.398154 20735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 19:02:11.414284 20735 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.252:41585
I20260809 19:02:11.414345 20826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.188.252:41585 every 8 connection(s)
I20260809 19:02:11.415515 20735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/data/info.pb
I20260809 19:02:11.419909 20827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 19:02:11.421506 17139 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr97ygv/build/asan/bin/kudu as pid 20735
I20260809 19:02:11.421676 17139 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr97ygv/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301765673554-17139-0/minicluster-data/master-2/wal/instance
I20260809 19:02:11.422111 17139 external_mini_cluster.cc:1428] Setting key a47abc277ecc73493d03d662e48d2d32
I20260809 19:02:11.429554 20827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302131, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:02:11.445168 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.423826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35344 (local address 127.16.188.252:41585)
0809 19:02:11.424542 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.424552 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.424593 (+ 41us) server_negotiation.cc:407] Connection header received
0809 19:02:11.426521 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.426543 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.426918 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.427221 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.429233 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.430520 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.432122 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.433159 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.433289 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.437860 (+ 4571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.437868 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.437878 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.437915 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.440898 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.441651 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.441659 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.441667 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.441850 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.442264 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.442269 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.442272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.442909 (+ 637us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.443183 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.443623 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.444007 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":307,"threads_started":1}
I20260809 19:02:11.447243 20832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.432160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.254:32879 (local address 127.0.0.1:45642)
0809 19:02:11.432867 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.432902 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:11.433066 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:11.433488 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:11.433492 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:11.434035 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:11.434258 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.434266 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.435633 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.435636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.436601 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.436612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.437421 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.437429 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.437577 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.438120 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:11.438152 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:11.440768 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:11.444755 (+ 3987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.444764 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.444769 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.445240 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.445689 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.445692 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.445694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.445823 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.446432 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:11.446438 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:11.446587 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 19:02:11.446726 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 19:02:11.446937 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":350,"threads_started":1}
I20260809 19:02:11.447453 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.432153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45642 (local address 127.16.188.254:32879)
0809 19:02:11.432317 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.432321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.433009 (+ 688us) server_negotiation.cc:407] Connection header received
0809 19:02:11.433224 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.433230 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.433320 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.433433 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.434419 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.435490 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.436731 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.437218 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.437337 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.441382 (+ 4045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.441387 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.441390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.441421 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.444621 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.445391 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.445397 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.445401 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.445549 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.445946 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.445950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.445952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.446294 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.446461 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.446887 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.447120 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:02:11.448758 20827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302131, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.254@KRBTEST.COM
I20260809 19:02:11.462050 20832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.449466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.253:42865 (local address 127.0.0.1:32846)
0809 19:02:11.449625 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.449642 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:11.449732 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:11.450012 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:11.450015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:11.450312 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:11.450431 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.450438 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.451490 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.451496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.452548 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.452559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.453416 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.453422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.453616 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.454066 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:11.454089 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:11.456192 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:11.459620 (+ 3428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.459624 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.459626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.459987 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.460373 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.460378 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.460382 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.460573 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.461154 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:11.461158 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:11.461327 (+ 169us) client_negotiation.cc:769] Sending connection context
0809 19:02:11.461447 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 19:02:11.461687 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 19:02:11.462065 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.449519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32846 (local address 127.16.188.253:42865)
0809 19:02:11.449734 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.449738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.449756 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:02:11.449814 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.449818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.449892 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.450006 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.450574 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.451355 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.452687 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.453278 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.453395 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.456369 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.456374 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.456377 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.456407 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.459449 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.460123 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.460126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.460129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.460254 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.460688 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.460693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.460695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.461010 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.461164 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.461558 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.461756 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 19:02:11.462980 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.448022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45652 (local address 127.16.188.254:32879)
0809 19:02:11.448180 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.448185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.448205 (+ 20us) server_negotiation.cc:407] Connection header received
0809 19:02:11.448324 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.448330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.448403 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.448513 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.449908 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.450796 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.452150 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.452556 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.452679 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.457023 (+ 4344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.457028 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.457031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.457066 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.459934 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.460670 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.460676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.460678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.460845 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.461242 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.461245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.461247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.461520 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.461799 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.462506 (+ 707us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.462709 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 19:02:11.462971 20827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302131, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.252@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.188.253@KRBTEST.COM
I20260809 19:02:11.475555 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.463615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35348 (local address 127.16.188.252:41585)
0809 19:02:11.463754 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.463760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.463808 (+ 48us) server_negotiation.cc:407] Connection header received
0809 19:02:11.463957 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.463962 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.464028 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.464109 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.464859 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.465846 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.467232 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.467769 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.467890 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.470695 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.470700 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.470703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.470730 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.473324 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.473883 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.473888 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.473891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.474027 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.474397 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.474400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.474402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.474698 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.474831 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.475195 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.475345 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 19:02:11.475894 20832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.463597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35348)
0809 19:02:11.463745 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.463762 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:11.463858 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:11.464155 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:11.464158 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:11.464549 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:11.464705 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.464717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.465964 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.465967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.467111 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.467125 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.467893 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.467897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.468064 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.468554 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:11.468570 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:11.470512 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:11.473441 (+ 2929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.473444 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.473447 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.473771 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.474119 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.474122 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.474126 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.474292 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.474813 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:11.474816 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:11.474964 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 19:02:11.475125 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 19:02:11.475487 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":102}
I20260809 19:02:11.479672 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.464575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32854 (local address 127.16.188.253:42865)
0809 19:02:11.464758 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.464763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.464779 (+ 16us) server_negotiation.cc:407] Connection header received
0809 19:02:11.464904 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.464907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.464956 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.465021 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.466370 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.467395 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.468911 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.469529 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.469653 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.474102 (+ 4449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.474107 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.474112 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.474147 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.477182 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.477785 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.477790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.477793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.477940 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.478391 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.478395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.478398 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.478713 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.478989 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.479152 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.479358 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 19:02:11.481477 20827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: Bootstrap starting.
I20260809 19:02:11.483949 17139 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 19:02:11.484733 20827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: Neither blocks nor log segments found. Creating new log.
I20260809 19:02:11.485776 20827 log.cc:824] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: Log is configured to *not* fsync() on all Append() calls
I20260809 19:02:11.488198 20827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: No bootstrap required, opened a new log
I20260809 19:02:11.486243 20593 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9eb515dc84db4805886148f6c8d293da"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45652
I20260809 19:02:11.494849 20827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } }
I20260809 19:02:11.495126 20827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e7e9e3015948f3a19ba4db57103237, State: Initialized, Role: FOLLOWER
I20260809 19:02:11.495528 20827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } }
I20260809 19:02:11.496404 20841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.496806 20841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:11.497336 20827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 19:02:11.505558 20853 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 19:02:11.505692 20853 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 19:02:11.503867 20735 master_runner.cc:186] Error getting master registration for 127.16.188.254:32879: OK, instance_id { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" instance_seqno: 1786302130409081 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:02:11.514386 20735 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:02:11.544592 20629 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 4
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.254@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
I20260809 19:02:11.559986 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.545343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35350)
0809 19:02:11.545635 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.545656 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:11.545774 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:11.546346 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:11.546351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:11.546871 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:11.547101 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.547114 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.548552 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.548558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.550029 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.550045 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.551028 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.551035 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.551242 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.551897 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:11.551922 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:11.554678 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:11.557650 (+ 2972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.557656 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.557660 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.558008 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.558349 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.558354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.558358 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.558497 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.559061 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:11.559066 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:11.559213 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 19:02:11.559329 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 19:02:11.559592 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155}
I20260809 19:02:11.560036 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.545387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35350 (local address 127.16.188.252:41585)
0809 19:02:11.546012 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.546018 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.546037 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:02:11.546092 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.546097 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.546168 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.546261 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.547263 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.548400 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.550167 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.550883 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.551003 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.554854 (+ 3851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.554862 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.554865 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.554898 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.557519 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.558124 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.558129 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.558131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.558245 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.558599 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.558605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.558608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.558945 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.559078 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.559475 (+ 397us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.559698 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471}
I20260809 19:02:11.565896 20629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da: Bootstrap starting.
I20260809 19:02:11.569995 20629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da: Neither blocks nor log segments found. Creating new log.
I20260809 19:02:11.571309 20629 log.cc:824] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da: Log is configured to *not* fsync() on all Append() calls
I20260809 19:02:11.574404 20629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da: No bootstrap required, opened a new log
I20260809 19:02:11.581768 20629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } }
I20260809 19:02:11.582155 20629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eb515dc84db4805886148f6c8d293da, State: Initialized, Role: FOLLOWER
I20260809 19:02:11.582645 20629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } }
I20260809 19:02:11.583622 20856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.584022 20856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:11.584846 20629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:02:11.585117 20593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 19:02:11.585345 20593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:02:11.587739 20593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } }
I20260809 19:02:11.589370 20593 leader_election.cc:288] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [CANDIDATE]: Term 1 election: Requested vote from peers d177979777c14524b819bc5e8aa52f3b (127.16.188.253:42865), 10e7e9e3015948f3a19ba4db57103237 (127.16.188.252:41585)
I20260809 19:02:11.589756 20797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9eb515dc84db4805886148f6c8d293da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "10e7e9e3015948f3a19ba4db57103237"
I20260809 19:02:11.590164 20797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:02:11.592449 20797 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eb515dc84db4805886148f6c8d293da in term 1.
I20260809 19:02:11.593658 20560 leader_election.cc:302] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10e7e9e3015948f3a19ba4db57103237, 9eb515dc84db4805886148f6c8d293da; no voters:
I20260809 19:02:11.594578 20856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [term 1 FOLLOWER]: Leader election won for term 1
I20260809 19:02:11.595153 20856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [term 1 LEADER]: Becoming Leader. State: Replica: 9eb515dc84db4805886148f6c8d293da, State: Running, Role: LEADER
I20260809 19:02:11.595686 20856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } }
I20260809 19:02:11.612967 20870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb515dc84db4805886148f6c8d293da. Latest consensus state: current_term: 1 leader_uuid: "9eb515dc84db4805886148f6c8d293da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.613435 20870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:11.618139 20874 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 19:02:11.618839 20728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } attempt: 5
I20260809 19:02:11.627065 20874 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 19:02:11 dist-test-slave-266d krb5kdc[20504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786302130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.188.253@KRBTEST.COM for kudu/127.16.188.252@KRBTEST.COM
I20260809 19:02:11.636144 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.619492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.188.252:41585 (local address 127.0.0.1:35356)
0809 19:02:11.619895 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0809 19:02:11.619915 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 19:02:11.620042 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 19:02:11.620932 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 19:02:11.620938 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 19:02:11.621510 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 19:02:11.621734 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.621748 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.623193 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.623199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.624490 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 19:02:11.624506 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.625639 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.625645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 19:02:11.625880 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.626530 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 19:02:11.626555 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 19:02:11.629389 (+ 2834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 19:02:11.633343 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.633350 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.633354 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.633866 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.634306 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 19:02:11.634311 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 19:02:11.634315 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 19:02:11.634514 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 19:02:11.635196 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 19:02:11.635201 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 19:02:11.635368 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 19:02:11.635510 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 19:02:11.635789 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254}
I20260809 19:02:11.637136 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.620257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35356 (local address 127.16.188.252:41585)
0809 19:02:11.620437 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.620444 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.620463 (+ 19us) server_negotiation.cc:407] Connection header received
0809 19:02:11.620526 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.620531 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.620611 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.620706 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.621948 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.623013 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.624667 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.625332 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.625452 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.629617 (+ 4165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.629625 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.629630 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.629670 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.633172 (+ 3502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.634011 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.634017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.634021 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.634180 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.634639 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.634644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.634648 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.634993 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.635130 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.636524 (+ 1394us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.636736 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 19:02:11.642724 20728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b: Bootstrap starting.
I20260809 19:02:11.646773 20728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b: Neither blocks nor log segments found. Creating new log.
I20260809 19:02:11.648029 20728 log.cc:824] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b: Log is configured to *not* fsync() on all Append() calls
W20260809 19:02:11.649421 20564 tablet.cc:2369] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 19:02:11.650099 20768 tablet.cc:2369] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 19:02:11.659709 20728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b: No bootstrap required, opened a new log
I20260809 19:02:11.668977 20797 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [term 1 FOLLOWER]: Refusing update from remote peer 9eb515dc84db4805886148f6c8d293da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:02:11.670544 20856 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [LEADER]: Connected to new peer: Peer: permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:02:11.678812 20728 raft_consensus.cc:348] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } }
I20260809 19:02:11.679198 20728 raft_consensus.cc:729] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d177979777c14524b819bc5e8aa52f3b, State: Initialized, Role: FOLLOWER
I20260809 19:02:11.679688 20728 consensus_queue.cc:260] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } }
I20260809 19:02:11.685670 20898 sys_catalog.cc:455] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.686084 20898 sys_catalog.cc:458] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:11.686823 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.637031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35358 (local address 127.16.188.252:41585)
0809 19:02:11.648679 (+ 11648us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.648685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.659149 (+ 10464us) server_negotiation.cc:407] Connection header received
0809 19:02:11.659410 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.659415 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.659493 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.659565 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.666118 (+ 6553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.667133 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.671099 (+ 3966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.671801 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.671898 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.676710 (+ 4812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.676717 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.676722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.676760 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.681779 (+ 5019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.683133 (+ 1354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.683139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.683142 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.683289 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.683908 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.683913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.683916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.684288 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.684525 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.685620 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.686201 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11512,"thread_start_us":34959,"threads_started":1}
I20260809 19:02:11.687795 20728 sys_catalog.cc:564] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 19:02:11.687897 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.628743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45654 (local address 127.16.188.254:32879)
0809 19:02:11.628899 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.628904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.638305 (+ 9401us) server_negotiation.cc:407] Connection header received
0809 19:02:11.639194 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.639200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.639292 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.639366 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.647035 (+ 7669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.648152 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.653839 (+ 5687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.654573 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.654682 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.662633 (+ 7951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.662639 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.662644 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.662725 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.666356 (+ 3631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.681697 (+ 15341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.681704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.681707 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.681905 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.684011 (+ 2106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.684016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.684019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.684363 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.684575 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.687216 (+ 2641us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.687458 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 19:02:11.688215 20688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [term 0 FOLLOWER]: Advancing to term 1
I20260809 19:02:11.688174 20690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9eb515dc84db4805886148f6c8d293da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d177979777c14524b819bc5e8aa52f3b"
I20260809 19:02:11.691979 20688 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [term 1 FOLLOWER]: Refusing update from remote peer 9eb515dc84db4805886148f6c8d293da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 19:02:11.693235 20856 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [LEADER]: Connected to new peer: Peer: permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 19:02:11.693601 20899 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 19:02:11.696169 20690 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eb515dc84db4805886148f6c8d293da in term 1.
I20260809 19:02:11.702921 20531 master_runner.cc:186] Error getting master registration for 127.16.188.253:42865: OK, instance_id { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" instance_seqno: 1786302130900279 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 19:02:11.714332 20531 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 19:02:11.715122 20841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb515dc84db4805886148f6c8d293da. Latest consensus state: current_term: 1 leader_uuid: "9eb515dc84db4805886148f6c8d293da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.715394 20841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:11.722321 20856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9eb515dc84db4805886148f6c8d293da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.722689 20856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:11.723990 20874 catalog_manager.cc:1347] Generated new cluster ID: 31197f2b68e6470babc4bf6afffdf32b
I20260809 19:02:11.724087 20874 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 19:02:11.725265 20841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9eb515dc84db4805886148f6c8d293da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.725514 20841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:11.726295 20898 sys_catalog.cc:455] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb515dc84db4805886148f6c8d293da. Latest consensus state: current_term: 1 leader_uuid: "9eb515dc84db4805886148f6c8d293da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.726574 20898 sys_catalog.cc:458] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:11.727939 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:11.628926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32856 (local address 127.16.188.253:42865)
0809 19:02:11.629175 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.629181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.643909 (+ 14728us) server_negotiation.cc:407] Connection header received
0809 19:02:11.644261 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.644267 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.644350 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.644420 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.650855 (+ 6435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.651892 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.657272 (+ 5380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:11.657985 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:11.658081 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:11.689144 (+ 31063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 19:02:11.689150 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 19:02:11.689155 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 19:02:11.689193 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 19:02:11.692848 (+ 3655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.716697 (+ 23849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.716703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.716707 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.716862 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 19:02:11.717760 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 19:02:11.717765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 19:02:11.717768 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 19:02:11.718170 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 19:02:11.718434 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:11.727314 (+ 8880us) server_negotiation.cc:299] Negotiation successful
0809 19:02:11.727590 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260809 19:02:11.727859 20870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9eb515dc84db4805886148f6c8d293da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.728092 20870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da [sys.catalog]: This master's current role is: LEADER
I20260809 19:02:11.740223 20874 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 19:02:11.742017 20874 catalog_manager.cc:1504] Loading token signing keys...
I20260809 19:02:11.742662 20898 sys_catalog.cc:455] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9eb515dc84db4805886148f6c8d293da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eb515dc84db4805886148f6c8d293da" member_type: VOTER last_known_addr { host: "127.16.188.254" port: 32879 } } peers { permanent_uuid: "d177979777c14524b819bc5e8aa52f3b" member_type: VOTER last_known_addr { host: "127.16.188.253" port: 42865 } } peers { permanent_uuid: "10e7e9e3015948f3a19ba4db57103237" member_type: VOTER last_known_addr { host: "127.16.188.252" port: 41585 } } }
I20260809 19:02:11.742903 20898 sys_catalog.cc:458] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 19:02:11.762149 20874 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eb515dc84db4805886148f6c8d293da: Generated new TSK 0
I20260809 19:02:11.763175 20874 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 19:02:11.765343 20924 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260809 19:02:11.861738 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.858046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32872 (local address 127.16.188.253:42865)
0809 19:02:11.858242 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.858248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.858843 (+ 595us) server_negotiation.cc:407] Connection header received
0809 19:02:11.859058 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.859064 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.859179 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.859278 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.861497 (+ 2219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32872: BlockingRecv error: recv got EOF from 127.0.0.1:32872 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 19:02:11.863277 20632 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.857821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45658 (local address 127.16.188.254:32879)
0809 19:02:11.858015 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.858021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.861647 (+ 3626us) server_negotiation.cc:407] Connection header received
0809 19:02:11.861861 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.861867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.861953 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.862029 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.863042 (+ 1013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45658: BlockingRecv error: recv got EOF from 127.0.0.1:45658 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 19:02:11.864012 20830 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.862192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35364 (local address 127.16.188.252:41585)
0809 19:02:11.862466 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.862472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.862489 (+ 17us) server_negotiation.cc:407] Connection header received
0809 19:02:11.862559 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.862564 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.862646 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.862748 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.863781 (+ 1033us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35364: BlockingRecv error: recv got EOF from 127.0.0.1:35364 (error 108)
Metrics: {"server-negotiator.queue_time_us":158}
W20260809 19:02:11.871052 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.868731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32878 (local address 127.16.188.253:42865)
0809 19:02:11.868884 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.868889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.869703 (+ 814us) server_negotiation.cc:407] Connection header received
0809 19:02:11.869900 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.869906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.870022 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.870127 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.870816 (+ 689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32878: BlockingRecv error: recv got EOF from 127.0.0.1:32878 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 19:02:11.877400 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.875496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32888 (local address 127.16.188.253:42865)
0809 19:02:11.875640 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.875645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.876096 (+ 451us) server_negotiation.cc:407] Connection header received
0809 19:02:11.876247 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.876252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.876348 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.876445 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.877205 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32888: BlockingRecv error: recv got EOF from 127.0.0.1:32888 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 19:02:11.889083 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.886929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32896 (local address 127.16.188.253:42865)
0809 19:02:11.887176 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.887181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.887753 (+ 572us) server_negotiation.cc:407] Connection header received
0809 19:02:11.887968 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.887974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.888068 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.888169 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.888852 (+ 683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32896: BlockingRecv error: recv got EOF from 127.0.0.1:32896 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260809 19:02:11.898015 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.896011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32898 (local address 127.16.188.253:42865)
0809 19:02:11.896211 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.896216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.896726 (+ 510us) server_negotiation.cc:407] Connection header received
0809 19:02:11.896885 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.896890 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.896969 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.897067 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.897803 (+ 736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32898: BlockingRecv error: recv got EOF from 127.0.0.1:32898 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260809 19:02:11.937911 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.935569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32906 (local address 127.16.188.253:42865)
0809 19:02:11.935773 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.935780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.936351 (+ 571us) server_negotiation.cc:407] Connection header received
0809 19:02:11.936569 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.936574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.936683 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.936806 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.937696 (+ 890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32906: BlockingRecv error: recv got EOF from 127.0.0.1:32906 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260809 19:02:11.959756 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.957534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32912 (local address 127.16.188.253:42865)
0809 19:02:11.957733 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.957739 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.958284 (+ 545us) server_negotiation.cc:407] Connection header received
0809 19:02:11.958468 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.958474 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.958584 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.958704 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.959526 (+ 822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32912: BlockingRecv error: recv got EOF from 127.0.0.1:32912 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260809 19:02:11.997875 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:11.995534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32916 (local address 127.16.188.253:42865)
0809 19:02:11.995738 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:11.995744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:11.996278 (+ 534us) server_negotiation.cc:407] Connection header received
0809 19:02:11.996486 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:11.996492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:11.996587 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:11.996691 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:11.997610 (+ 919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32916: BlockingRecv error: recv got EOF from 127.0.0.1:32916 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260809 19:02:12.067476 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:12.065499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32924 (local address 127.16.188.253:42865)
0809 19:02:12.065679 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:12.065684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:12.066015 (+ 331us) server_negotiation.cc:407] Connection header received
0809 19:02:12.066211 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:12.066215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:12.066296 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:12.066379 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:12.067252 (+ 873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32924: BlockingRecv error: recv got EOF from 127.0.0.1:32924 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 19:02:12.200827 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:12.198899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32926 (local address 127.16.188.253:42865)
0809 19:02:12.199073 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:12.199078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:12.199502 (+ 424us) server_negotiation.cc:407] Connection header received
0809 19:02:12.199701 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:12.199705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:12.199777 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:12.199854 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:12.200555 (+ 701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32926: BlockingRecv error: recv got EOF from 127.0.0.1:32926 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 19:02:12.461819 20732 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 19:02:12.459980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32936 (local address 127.16.188.253:42865)
0809 19:02:12.460196 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:12.460202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:12.460405 (+ 203us) server_negotiation.cc:407] Connection header received
0809 19:02:12.460636 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:12.460640 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:12.460715 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:12.460807 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 19:02:12.461610 (+ 803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32936: BlockingRecv error: recv got EOF from 127.0.0.1:32936 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 19:02:12.507645 20853 catalog_manager.cc:1259] Loaded cluster ID: 31197f2b68e6470babc4bf6afffdf32b
I20260809 19:02:12.507738 20853 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: loading cluster ID for follower catalog manager: success
I20260809 19:02:12.510380 20853 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: acquiring CA information for follower catalog manager: success
I20260809 19:02:12.512236 20853 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 10e7e9e3015948f3a19ba4db57103237: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:02:12.769882 20924 catalog_manager.cc:1259] Loaded cluster ID: 31197f2b68e6470babc4bf6afffdf32b
I20260809 19:02:12.770010 20924 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b: loading cluster ID for follower catalog manager: success
I20260809 19:02:12.772722 20924 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b: acquiring CA information for follower catalog manager: success
I20260809 19:02:12.774510 20924 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d177979777c14524b819bc5e8aa52f3b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 19:02:12.984411 21023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:12.977602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32938 (local address 127.16.188.253:42865)
0809 19:02:12.978591 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:12.978598 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:12.978620 (+ 22us) server_negotiation.cc:407] Connection header received
0809 19:02:12.978706 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:12.978710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:12.978868 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:12.978996 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:12.979506 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:12.980370 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:12.981864 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:12.982373 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:12.982505 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:12.983073 (+ 568us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:12.983677 (+ 604us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:12.983834 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:12.983943 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 19:02:12.984033 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":794,"thread_start_us":685,"threads_started":1}
I20260809 19:02:13.001068 21032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:12.994509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35366 (local address 127.16.188.252:41585)
0809 19:02:12.995139 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:12.995144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:12.995162 (+ 18us) server_negotiation.cc:407] Connection header received
0809 19:02:12.995257 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:12.995261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:12.995412 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:12.995558 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:12.995995 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:12.996752 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:12.998763 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:12.999212 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:12.999308 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:12.999935 (+ 627us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:13.000469 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:13.000627 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:13.000716 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 19:02:13.000786 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":387,"threads_started":1}
I20260809 19:02:13.024219 21023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:13.007808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32948 (local address 127.16.188.253:42865)
0809 19:02:13.007974 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:13.007980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:13.018102 (+ 10122us) server_negotiation.cc:407] Connection header received
0809 19:02:13.018276 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:13.018280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:13.018354 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:13.018444 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:13.018977 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:13.019829 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:13.021825 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:13.022485 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:13.022581 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:13.023365 (+ 784us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:13.023493 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:13.023551 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:13.023788 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 19:02:13.023879 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 19:02:13.026218 21032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:13.007751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35368 (local address 127.16.188.252:41585)
0809 19:02:13.007996 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:13.008001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:13.019687 (+ 11686us) server_negotiation.cc:407] Connection header received
0809 19:02:13.020150 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:13.020157 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:13.020251 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:13.020339 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:13.021148 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:13.022162 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:13.024221 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:13.024802 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:13.024877 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:13.025472 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:13.025611 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:13.025667 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:13.025859 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 19:02:13.025934 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260809 19:02:13.029170 21040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 19:02:13.007534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45666 (local address 127.16.188.254:32879)
0809 19:02:13.017615 (+ 10081us) server_negotiation.cc:206] Beginning negotiation
0809 19:02:13.017622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 19:02:13.020150 (+ 2528us) server_negotiation.cc:407] Connection header received
0809 19:02:13.020303 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 19:02:13.020308 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 19:02:13.020545 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 19:02:13.021498 (+ 953us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 19:02:13.021688 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:13.022766 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:13.025275 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 19:02:13.027135 (+ 1860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 19:02:13.027757 (+ 622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 19:02:13.027972 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 19:02:13.028442 (+ 470us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 19:02:13.028566 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 19:02:13.028740 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 19:02:13.028828 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9938,"spinlock_wait_cycles":2304,"thread_start_us":9921,"threads_started":1}
I20260809 19:02:13.034159 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20531
I20260809 19:02:13.035279 20622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:02:13.145103 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20531
I20260809 19:02:13.173483 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20638
I20260809 19:02:13.174576 20723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:02:13.278750 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20638
I20260809 19:02:13.306291 17139 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskr97ygv/build/asan/bin/kudu pid 20735
I20260809 19:02:13.307343 20821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 19:02:13.411070 17139 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr97ygv/build/asan/bin/kudu with pid 20735
2026-08-09T19:02:13Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4979 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9685 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (367659 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST